2024-09-16T07:23:05.928 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-16T07:23:05.947 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-16T07:23:06.025 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/matan-2024-09-16_07:15:55-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7906859 branch: wip-matanb-crimson-testing-59543 description: crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore tasks/rados_api_tests} email: null first_in_suite: false job_id: '7906859' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: matan-2024-09-16_07:15:55-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-matanb-crimson-testing-59543 ceph: conf: client: debug ms: 1 global: enable experimental unrecoverable data corrupting features: crimson ms client mode: crc ms cluster mode: crc ms mon client mode: crc ms mon cluster mode: crc ms mon service mode: crc ms service mode: crc mgr: debug mgr: 20 debug ms: 1 mgr stats period: 30 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon warn on pool no app: false osd pool default crimson: true osd: bluestore block size: 96636764160 bluestore compression algorithm: snappy bluestore compression mode: aggressive bluestore fsck on mount: true bluestore rocksdb cf: false crimson alien thread cpu cores: 6-7 crimson osd obc lru size: 10 debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 err to stderr: true log flush on exit: true log to file: false log to stderr: true mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd class default list: '*' osd class load list: '*' osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd.0: crimson seastar cpu cores: 0-2 osd.1: crimson seastar cpu cores: 3-5 osd.2: crimson seastar cpu cores: 0-2 osd.3: crimson seastar cpu cores: 3-5 flavor: crimson fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(POOL_APP_NOT_ENABLED\) - reached quota - but it is still running - overall HEALTH_ - \(POOL_FULL\) - \(SMALLER_PGP_NUM\) - \(CACHE_POOL_NO_HIT_SET\) - \(CACHE_POOL_NEAR_FULL\) - \(POOL_APP_NOT_ENABLED\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) sha1: 81fedcb3b484c843d22ffbc8d179cb567b7083b5 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: crimson sha1: 81fedcb3b484c843d22ffbc8d179cb567b7083b5 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 workunit: branch: main env: CRIMSON_COMPAT: '1' sha1: 0325fd3c11a225c0fd9eb38fab88aad1370ad779 owner: scheduled_matan@teuthology priority: 60 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - osd.0 - osd.1 - client.0 - node-exporter.a - - mgr.x - osd.2 - osd.3 - client.1 - prometheus.a - node-exporter.b seed: 6651 sha1: 81fedcb3b484c843d22ffbc8d179cb567b7083b5 sleep_before_teardown: 0 suite: crimson-rados suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 0325fd3c11a225c0fd9eb38fab88aad1370ad779 targets: smithi121.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOzX5F/GByLb6FRiF4XYzbPpgSLgVSjSvYKqja56Pbr273g4i3/6XrHYQeSgZd+DoGgwz2H2AiSnT1Xnl3ClC48= smithi172.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKDRtyWet5Ple/wpGFipoPZqSr/3zGFdvxZZl5uSlLgGN6QNrXgInCV2oWNFDQdDKBINGCGzsrfQSRRVo/571hw= tasks: - install: null - ceph: conf: mon: mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 paxos service trim min: 10 osd: debug monc: 20 flavor: crimson - workunit: clients: client.0: - rados/test.sh --crimson - rados/test_pool_quota.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-16_07:15:55 tube: smithi user: matan verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-16T07:23:06.025 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa; will attempt to use it 2024-09-16T07:23:06.026 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa/tasks 2024-09-16T07:23:06.026 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-16T07:23:06.028 INFO:teuthology.task.internal:Checking packages... 2024-09-16T07:23:06.049 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'crimson' and ceph hash '81fedcb3b484c843d22ffbc8d179cb567b7083b5' 2024-09-16T07:23:06.049 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-16T07:23:06.049 INFO:teuthology.packaging:ref: None 2024-09-16T07:23:06.049 INFO:teuthology.packaging:tag: None 2024-09-16T07:23:06.049 INFO:teuthology.packaging:branch: wip-matanb-crimson-testing-59543 2024-09-16T07:23:06.049 INFO:teuthology.packaging:sha1: 81fedcb3b484c843d22ffbc8d179cb567b7083b5 2024-09-16T07:23:06.049 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&ref=wip-matanb-crimson-testing-59543 2024-09-16T07:23:06.189 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4879.g81fedcb3 2024-09-16T07:23:06.191 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-16T07:23:06.197 INFO:teuthology.task.internal:no buildpackages task found 2024-09-16T07:23:06.197 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-16T07:23:06.203 INFO:teuthology.task.internal:Saving configuration 2024-09-16T07:23:06.216 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-16T07:23:06.223 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-16T07:23:06.249 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi121.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2024-09-16_07:15:55-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7906859', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-16 07:18:07.928745', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOzX5F/GByLb6FRiF4XYzbPpgSLgVSjSvYKqja56Pbr273g4i3/6XrHYQeSgZd+DoGgwz2H2AiSnT1Xnl3ClC48='} 2024-09-16T07:23:06.271 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi172.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2024-09-16_07:15:55-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7906859', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-16 07:18:07.930174', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKDRtyWet5Ple/wpGFipoPZqSr/3zGFdvxZZl5uSlLgGN6QNrXgInCV2oWNFDQdDKBINGCGzsrfQSRRVo/571hw='} 2024-09-16T07:23:06.272 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-16T07:23:06.277 INFO:teuthology.task.internal:roles: ubuntu@smithi121.front.sepia.ceph.com - ['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'] 2024-09-16T07:23:06.278 INFO:teuthology.task.internal:roles: ubuntu@smithi172.front.sepia.ceph.com - ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-16T07:23:06.278 INFO:teuthology.run_tasks:Running task console_log... 2024-09-16T07:23:06.339 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f41f882bbe0>, signals=[15]) 2024-09-16T07:23:06.339 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-16T07:23:06.346 INFO:teuthology.task.internal:Opening connections... 2024-09-16T07:23:06.347 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi121.front.sepia.ceph.com 2024-09-16T07:23:06.348 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T07:23:06.436 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi172.front.sepia.ceph.com 2024-09-16T07:23:06.437 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T07:23:06.517 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-16T07:23:06.523 DEBUG:teuthology.orchestra.run.smithi121:> uname -m 2024-09-16T07:23:06.542 INFO:teuthology.orchestra.run.smithi121.stdout:x86_64 2024-09-16T07:23:06.542 DEBUG:teuthology.orchestra.run.smithi121:> cat /etc/os-release 2024-09-16T07:23:06.601 INFO:teuthology.orchestra.run.smithi121.stdout:NAME="CentOS Stream" 2024-09-16T07:23:06.601 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION="9" 2024-09-16T07:23:06.601 INFO:teuthology.orchestra.run.smithi121.stdout:ID="centos" 2024-09-16T07:23:06.601 INFO:teuthology.orchestra.run.smithi121.stdout:ID_LIKE="rhel fedora" 2024-09-16T07:23:06.601 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION_ID="9" 2024-09-16T07:23:06.601 INFO:teuthology.orchestra.run.smithi121.stdout:PLATFORM_ID="platform:el9" 2024-09-16T07:23:06.601 INFO:teuthology.orchestra.run.smithi121.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-16T07:23:06.601 INFO:teuthology.orchestra.run.smithi121.stdout:ANSI_COLOR="0;31" 2024-09-16T07:23:06.601 INFO:teuthology.orchestra.run.smithi121.stdout:LOGO="fedora-logo-icon" 2024-09-16T07:23:06.601 INFO:teuthology.orchestra.run.smithi121.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-16T07:23:06.601 INFO:teuthology.orchestra.run.smithi121.stdout:HOME_URL="https://centos.org/" 2024-09-16T07:23:06.601 INFO:teuthology.orchestra.run.smithi121.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-16T07:23:06.602 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-16T07:23:06.602 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-16T07:23:06.603 INFO:teuthology.lock.ops:Updating smithi121.front.sepia.ceph.com on lock server 2024-09-16T07:23:06.636 DEBUG:teuthology.orchestra.run.smithi172:> uname -m 2024-09-16T07:23:06.655 INFO:teuthology.orchestra.run.smithi172.stdout:x86_64 2024-09-16T07:23:06.655 DEBUG:teuthology.orchestra.run.smithi172:> cat /etc/os-release 2024-09-16T07:23:06.712 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="CentOS Stream" 2024-09-16T07:23:06.713 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="9" 2024-09-16T07:23:06.713 INFO:teuthology.orchestra.run.smithi172.stdout:ID="centos" 2024-09-16T07:23:06.713 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE="rhel fedora" 2024-09-16T07:23:06.713 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="9" 2024-09-16T07:23:06.713 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM_ID="platform:el9" 2024-09-16T07:23:06.713 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-16T07:23:06.713 INFO:teuthology.orchestra.run.smithi172.stdout:ANSI_COLOR="0;31" 2024-09-16T07:23:06.713 INFO:teuthology.orchestra.run.smithi172.stdout:LOGO="fedora-logo-icon" 2024-09-16T07:23:06.713 INFO:teuthology.orchestra.run.smithi172.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-16T07:23:06.713 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://centos.org/" 2024-09-16T07:23:06.713 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-16T07:23:06.713 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-16T07:23:06.713 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-16T07:23:06.714 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2024-09-16T07:23:06.752 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-16T07:23:06.760 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-16T07:23:06.765 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-16T07:23:06.765 DEBUG:teuthology.orchestra.run.smithi121:> test '!' -e /home/ubuntu/cephtest 2024-09-16T07:23:06.768 DEBUG:teuthology.orchestra.run.smithi172:> test '!' -e /home/ubuntu/cephtest 2024-09-16T07:23:06.784 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-16T07:23:06.792 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-16T07:23:06.792 DEBUG:teuthology.orchestra.run.smithi121:> test -z $(ls -A /var/lib/ceph) 2024-09-16T07:23:06.826 DEBUG:teuthology.orchestra.run.smithi172:> test -z $(ls -A /var/lib/ceph) 2024-09-16T07:23:06.923 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-16T07:23:06.976 INFO:teuthology.run_tasks:Running task kernel... 2024-09-16T07:23:06.992 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-09-16T07:23:06.992 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-09-16T07:23:06.992 DEBUG:teuthology.orchestra.run.smithi121:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-16T07:23:06.993 DEBUG:teuthology.orchestra.run.smithi172:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-16T07:23:07.009 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T07:23:07.010 DEBUG:teuthology.orchestra.run.smithi121:> uname -r 2024-09-16T07:23:07.011 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T07:23:07.011 DEBUG:teuthology.orchestra.run.smithi172:> uname -r 2024-09-16T07:23:07.068 INFO:teuthology.orchestra.run.smithi121.stdout:5.14.0-503.el9.x86_64 2024-09-16T07:23:07.068 INFO:teuthology.task.kernel:Running kernel on smithi121: 5.14.0-503.el9.x86_64 2024-09-16T07:23:07.068 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum install -y kernel 2024-09-16T07:23:07.069 INFO:teuthology.orchestra.run.smithi172.stdout:5.14.0-503.el9.x86_64 2024-09-16T07:23:07.069 INFO:teuthology.task.kernel:Running kernel on smithi172: 5.14.0-503.el9.x86_64 2024-09-16T07:23:07.069 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum install -y kernel 2024-09-16T07:23:10.509 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - BaseOS 4.9 MB/s | 8.2 MB 00:01 2024-09-16T07:23:10.665 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - BaseOS 4.5 MB/s | 8.2 MB 00:01 2024-09-16T07:23:14.592 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - AppStream 7.2 MB/s | 20 MB 00:02 2024-09-16T07:23:19.091 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - CRB 9.2 MB/s | 6.5 MB 00:00 2024-09-16T07:23:19.983 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - AppStream 2.4 MB/s | 20 MB 00:08 2024-09-16T07:23:20.491 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - Extras packages 91 kB/s | 19 kB 00:00 2024-09-16T07:23:21.295 INFO:teuthology.orchestra.run.smithi121.stdout:Extra Packages for Enterprise Linux 33 MB/s | 23 MB 00:00 2024-09-16T07:23:26.175 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - CRB 2.7 MB/s | 6.5 MB 00:02 2024-09-16T07:23:26.726 INFO:teuthology.orchestra.run.smithi121.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-16T07:23:27.925 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - Extras packages 35 kB/s | 19 kB 00:00 2024-09-16T07:23:28.654 INFO:teuthology.orchestra.run.smithi172.stdout:Extra Packages for Enterprise Linux 37 MB/s | 23 MB 00:00 2024-09-16T07:23:28.740 INFO:teuthology.orchestra.run.smithi121.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-16T07:23:28.740 INFO:teuthology.orchestra.run.smithi121.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-16T07:23:28.825 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2024-09-16T07:23:28.835 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-09-16T07:23:28.835 INFO:teuthology.orchestra.run.smithi121.stdout: Package Architecture Version Repository Size 2024-09-16T07:23:28.835 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-09-16T07:23:28.835 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2024-09-16T07:23:28.836 INFO:teuthology.orchestra.run.smithi121.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-16T07:23:28.836 INFO:teuthology.orchestra.run.smithi121.stdout:Installing dependencies: 2024-09-16T07:23:28.836 INFO:teuthology.orchestra.run.smithi121.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-16T07:23:28.836 INFO:teuthology.orchestra.run.smithi121.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-16T07:23:28.836 INFO:teuthology.orchestra.run.smithi121.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-16T07:23:28.836 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:23:28.836 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2024-09-16T07:23:28.836 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-09-16T07:23:28.836 INFO:teuthology.orchestra.run.smithi121.stdout:Install 4 Packages 2024-09-16T07:23:28.836 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:23:28.837 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 79 M 2024-09-16T07:23:28.837 INFO:teuthology.orchestra.run.smithi121.stdout:Installed size: 126 M 2024-09-16T07:23:28.837 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading Packages: 2024-09-16T07:23:29.527 INFO:teuthology.orchestra.run.smithi121.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 39 kB/s | 23 kB 00:00 2024-09-16T07:23:30.311 INFO:teuthology.orchestra.run.smithi121.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-09-16T07:23:31.169 INFO:teuthology.orchestra.run.smithi121.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 15 MB/s | 35 MB 00:02 2024-09-16T07:23:31.852 INFO:teuthology.orchestra.run.smithi121.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 12 MB/s | 29 MB 00:02 2024-09-16T07:23:31.853 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:23:31.853 INFO:teuthology.orchestra.run.smithi121.stdout:Total 26 MB/s | 79 MB 00:03 2024-09-16T07:23:32.538 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2024-09-16T07:23:32.881 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction check succeeded. 2024-09-16T07:23:32.881 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2024-09-16T07:23:33.832 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded. 2024-09-16T07:23:33.833 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2024-09-16T07:23:34.052 INFO:teuthology.orchestra.run.smithi172.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-16T07:23:36.075 INFO:teuthology.orchestra.run.smithi172.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-16T07:23:36.075 INFO:teuthology.orchestra.run.smithi172.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-16T07:23:36.169 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-16T07:23:36.174 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T07:23:36.174 INFO:teuthology.orchestra.run.smithi172.stdout: Package Architecture Version Repository Size 2024-09-16T07:23:36.174 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T07:23:36.174 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-09-16T07:23:36.174 INFO:teuthology.orchestra.run.smithi172.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-16T07:23:36.174 INFO:teuthology.orchestra.run.smithi172.stdout:Installing dependencies: 2024-09-16T07:23:36.174 INFO:teuthology.orchestra.run.smithi172.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-16T07:23:36.174 INFO:teuthology.orchestra.run.smithi172.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-16T07:23:36.174 INFO:teuthology.orchestra.run.smithi172.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-16T07:23:36.174 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:23:36.174 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-09-16T07:23:36.174 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T07:23:36.175 INFO:teuthology.orchestra.run.smithi172.stdout:Install 4 Packages 2024-09-16T07:23:36.175 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:23:36.175 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 79 M 2024-09-16T07:23:36.175 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 126 M 2024-09-16T07:23:36.175 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-09-16T07:23:36.310 INFO:teuthology.orchestra.run.smithi121.stdout: Preparing : 1/1 2024-09-16T07:23:36.912 INFO:teuthology.orchestra.run.smithi172.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 41 kB/s | 23 kB 00:00 2024-09-16T07:23:36.985 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-16T07:23:37.061 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T07:23:39.187 INFO:teuthology.orchestra.run.smithi172.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 5.5 MB/s | 16 MB 00:02 2024-09-16T07:23:39.678 INFO:teuthology.orchestra.run.smithi172.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 10 MB/s | 29 MB 00:02 2024-09-16T07:23:39.847 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T07:23:39.982 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T07:23:40.129 INFO:teuthology.orchestra.run.smithi172.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 9.2 MB/s | 35 MB 00:03 2024-09-16T07:23:40.129 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:23:40.129 INFO:teuthology.orchestra.run.smithi172.stdout:Total 20 MB/s | 79 MB 00:03 2024-09-16T07:23:40.815 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-09-16T07:23:41.163 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-09-16T07:23:41.163 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-09-16T07:23:42.110 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-09-16T07:23:42.111 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-09-16T07:23:44.543 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-09-16T07:23:44.798 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T07:23:44.898 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-16T07:23:45.185 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-16T07:23:45.280 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T07:23:48.089 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T07:23:48.225 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T07:23:49.781 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T07:23:53.083 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T07:23:53.125 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-16T07:23:57.979 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T07:24:28.198 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T07:24:28.239 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-16T07:24:28.571 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-16T07:24:28.571 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-16T07:24:28.571 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T07:24:28.571 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T07:24:29.420 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T07:24:29.420 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:24:29.420 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2024-09-16T07:24:29.420 INFO:teuthology.orchestra.run.smithi121.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-16T07:24:29.420 INFO:teuthology.orchestra.run.smithi121.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-16T07:24:29.420 INFO:teuthology.orchestra.run.smithi121.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-16T07:24:29.420 INFO:teuthology.orchestra.run.smithi121.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-16T07:24:29.421 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:24:29.421 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2024-09-16T07:24:29.719 DEBUG:teuthology.orchestra.run.smithi121:> rpm -q kernel | sort -rV | head -n 1 2024-09-16T07:24:29.803 INFO:teuthology.orchestra.run.smithi121.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-16T07:24:29.803 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-16T07:24:29.803 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-16T07:24:29.803 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-16T07:24:29.803 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-16T07:24:29.804 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-16T07:24:29.804 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi121.front.sepia.ceph.com, path=None, version=distro) 2024-09-16T07:24:29.804 DEBUG:teuthology.orchestra.run.smithi121:> rpm -q kernel | sort -rV | head -n 1 2024-09-16T07:24:29.861 INFO:teuthology.orchestra.run.smithi121.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-16T07:24:29.862 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-16T07:24:29.863 DEBUG:teuthology.orchestra.run.smithi121:> sudo rpm -qi grub2-tools 2024-09-16T07:24:29.894 INFO:teuthology.orchestra.run.smithi121.stdout:Name : grub2-tools 2024-09-16T07:24:29.894 INFO:teuthology.orchestra.run.smithi121.stdout:Epoch : 1 2024-09-16T07:24:29.894 INFO:teuthology.orchestra.run.smithi121.stdout:Version : 2.06 2024-09-16T07:24:29.894 INFO:teuthology.orchestra.run.smithi121.stdout:Release : 82.el9 2024-09-16T07:24:29.894 INFO:teuthology.orchestra.run.smithi121.stdout:Architecture: x86_64 2024-09-16T07:24:29.894 INFO:teuthology.orchestra.run.smithi121.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-16T07:24:29.894 INFO:teuthology.orchestra.run.smithi121.stdout:Group : Unspecified 2024-09-16T07:24:29.895 INFO:teuthology.orchestra.run.smithi121.stdout:Size : 8274670 2024-09-16T07:24:29.895 INFO:teuthology.orchestra.run.smithi121.stdout:License : GPLv3+ 2024-09-16T07:24:29.895 INFO:teuthology.orchestra.run.smithi121.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-16T07:24:29.895 INFO:teuthology.orchestra.run.smithi121.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-16T07:24:29.895 INFO:teuthology.orchestra.run.smithi121.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-16T07:24:29.895 INFO:teuthology.orchestra.run.smithi121.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-16T07:24:29.895 INFO:teuthology.orchestra.run.smithi121.stdout:Packager : builder@centos.org 2024-09-16T07:24:29.895 INFO:teuthology.orchestra.run.smithi121.stdout:Vendor : CentOS 2024-09-16T07:24:29.895 INFO:teuthology.orchestra.run.smithi121.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-16T07:24:29.895 INFO:teuthology.orchestra.run.smithi121.stdout:Summary : Support tools for GRUB. 2024-09-16T07:24:29.895 INFO:teuthology.orchestra.run.smithi121.stdout:Description : 2024-09-16T07:24:29.895 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:24:29.895 INFO:teuthology.orchestra.run.smithi121.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-16T07:24:29.895 INFO:teuthology.orchestra.run.smithi121.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-16T07:24:29.895 INFO:teuthology.orchestra.run.smithi121.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-16T07:24:29.896 INFO:teuthology.orchestra.run.smithi121.stdout:hardware devices. 2024-09-16T07:24:29.896 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:24:29.896 INFO:teuthology.orchestra.run.smithi121.stdout:This subpackage provides tools for support of all platforms. 2024-09-16T07:24:29.896 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-16T07:24:29.897 INFO:teuthology.task.kernel:Updating grub on smithi121 to boot 5.14.0-505.el9.x86_64 2024-09-16T07:24:29.897 DEBUG:teuthology.orchestra.run.smithi121:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-16T07:24:30.504 INFO:teuthology.orchestra.run.smithi121.stderr:Generating grub configuration file ... 2024-09-16T07:24:31.863 INFO:teuthology.orchestra.run.smithi121.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-16T07:24:31.896 INFO:teuthology.orchestra.run.smithi121.stderr:done 2024-09-16T07:24:31.898 DEBUG:teuthology.orchestra.run.smithi121:> mktemp 2024-09-16T07:24:31.913 INFO:teuthology.orchestra.run.smithi121.stdout:/tmp/tmp.anohDcvVvy 2024-09-16T07:24:31.914 DEBUG:teuthology.orchestra.run.smithi121:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.anohDcvVvy 2024-09-16T07:24:31.981 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 0666 /tmp/tmp.anohDcvVvy 2024-09-16T07:24:32.121 DEBUG:teuthology.orchestra.remote:smithi121:/tmp/tmp.anohDcvVvy is 6KB 2024-09-16T07:24:32.141 DEBUG:teuthology.orchestra.run.smithi121:> rm -fr /tmp/tmp.anohDcvVvy 2024-09-16T07:24:32.156 DEBUG:teuthology.orchestra.run.smithi121:> sudo /bin/ls /boot/loader/entries || true 2024-09-16T07:24:32.218 INFO:teuthology.orchestra.run.smithi121.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-16T07:24:32.218 INFO:teuthology.orchestra.run.smithi121.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-16T07:24:32.218 INFO:teuthology.orchestra.run.smithi121.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-16T07:24:32.218 INFO:teuthology.orchestra.run.smithi121.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-16T07:24:32.220 DEBUG:teuthology.orchestra.run.smithi121:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-16T07:24:32.370 DEBUG:teuthology.orchestra.run.smithi121:> sudo shutdown -r now 2024-09-16T07:24:36.024 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T07:24:36.064 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-16T07:24:36.410 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-16T07:24:36.410 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-16T07:24:36.411 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T07:24:36.411 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T07:24:37.257 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T07:24:37.258 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:24:37.258 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-09-16T07:24:37.258 INFO:teuthology.orchestra.run.smithi172.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-16T07:24:37.258 INFO:teuthology.orchestra.run.smithi172.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-16T07:24:37.258 INFO:teuthology.orchestra.run.smithi172.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-16T07:24:37.258 INFO:teuthology.orchestra.run.smithi172.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-16T07:24:37.258 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:24:37.258 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-16T07:24:37.622 DEBUG:teuthology.orchestra.run.smithi172:> rpm -q kernel | sort -rV | head -n 1 2024-09-16T07:24:37.716 INFO:teuthology.orchestra.run.smithi172.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-16T07:24:37.717 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-16T07:24:37.717 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-16T07:24:37.717 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-16T07:24:37.717 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-16T07:24:37.717 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2024-09-16T07:24:37.717 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi172.front.sepia.ceph.com, path=None, version=distro) 2024-09-16T07:24:37.717 DEBUG:teuthology.orchestra.run.smithi172:> rpm -q kernel | sort -rV | head -n 1 2024-09-16T07:24:37.775 INFO:teuthology.orchestra.run.smithi172.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-16T07:24:37.776 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-16T07:24:37.776 DEBUG:teuthology.orchestra.run.smithi172:> sudo rpm -qi grub2-tools 2024-09-16T07:24:37.817 INFO:teuthology.orchestra.run.smithi172.stdout:Name : grub2-tools 2024-09-16T07:24:37.817 INFO:teuthology.orchestra.run.smithi172.stdout:Epoch : 1 2024-09-16T07:24:37.817 INFO:teuthology.orchestra.run.smithi172.stdout:Version : 2.06 2024-09-16T07:24:37.817 INFO:teuthology.orchestra.run.smithi172.stdout:Release : 82.el9 2024-09-16T07:24:37.817 INFO:teuthology.orchestra.run.smithi172.stdout:Architecture: x86_64 2024-09-16T07:24:37.817 INFO:teuthology.orchestra.run.smithi172.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-16T07:24:37.817 INFO:teuthology.orchestra.run.smithi172.stdout:Group : Unspecified 2024-09-16T07:24:37.818 INFO:teuthology.orchestra.run.smithi172.stdout:Size : 8274670 2024-09-16T07:24:37.818 INFO:teuthology.orchestra.run.smithi172.stdout:License : GPLv3+ 2024-09-16T07:24:37.818 INFO:teuthology.orchestra.run.smithi172.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-16T07:24:37.818 INFO:teuthology.orchestra.run.smithi172.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-16T07:24:37.818 INFO:teuthology.orchestra.run.smithi172.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-16T07:24:37.818 INFO:teuthology.orchestra.run.smithi172.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-16T07:24:37.818 INFO:teuthology.orchestra.run.smithi172.stdout:Packager : builder@centos.org 2024-09-16T07:24:37.818 INFO:teuthology.orchestra.run.smithi172.stdout:Vendor : CentOS 2024-09-16T07:24:37.818 INFO:teuthology.orchestra.run.smithi172.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-16T07:24:37.818 INFO:teuthology.orchestra.run.smithi172.stdout:Summary : Support tools for GRUB. 2024-09-16T07:24:37.818 INFO:teuthology.orchestra.run.smithi172.stdout:Description : 2024-09-16T07:24:37.818 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:24:37.818 INFO:teuthology.orchestra.run.smithi172.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-16T07:24:37.818 INFO:teuthology.orchestra.run.smithi172.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-16T07:24:37.818 INFO:teuthology.orchestra.run.smithi172.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-16T07:24:37.818 INFO:teuthology.orchestra.run.smithi172.stdout:hardware devices. 2024-09-16T07:24:37.819 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:24:37.819 INFO:teuthology.orchestra.run.smithi172.stdout:This subpackage provides tools for support of all platforms. 2024-09-16T07:24:37.819 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-16T07:24:37.819 INFO:teuthology.task.kernel:Updating grub on smithi172 to boot 5.14.0-505.el9.x86_64 2024-09-16T07:24:37.820 DEBUG:teuthology.orchestra.run.smithi172:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-16T07:24:38.480 INFO:teuthology.orchestra.run.smithi172.stderr:Generating grub configuration file ... 2024-09-16T07:24:39.818 INFO:teuthology.orchestra.run.smithi172.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-16T07:24:39.860 INFO:teuthology.orchestra.run.smithi172.stderr:done 2024-09-16T07:24:39.862 DEBUG:teuthology.orchestra.run.smithi172:> mktemp 2024-09-16T07:24:39.878 INFO:teuthology.orchestra.run.smithi172.stdout:/tmp/tmp.4MqBpE4JzF 2024-09-16T07:24:39.878 DEBUG:teuthology.orchestra.run.smithi172:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.4MqBpE4JzF 2024-09-16T07:24:39.951 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 0666 /tmp/tmp.4MqBpE4JzF 2024-09-16T07:24:40.085 DEBUG:teuthology.orchestra.remote:smithi172:/tmp/tmp.4MqBpE4JzF is 6KB 2024-09-16T07:24:40.134 DEBUG:teuthology.orchestra.run.smithi172:> rm -fr /tmp/tmp.4MqBpE4JzF 2024-09-16T07:24:40.148 DEBUG:teuthology.orchestra.run.smithi172:> sudo /bin/ls /boot/loader/entries || true 2024-09-16T07:24:40.211 INFO:teuthology.orchestra.run.smithi172.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-16T07:24:40.211 INFO:teuthology.orchestra.run.smithi172.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-16T07:24:40.212 INFO:teuthology.orchestra.run.smithi172.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-16T07:24:40.212 INFO:teuthology.orchestra.run.smithi172.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-16T07:24:40.213 DEBUG:teuthology.orchestra.run.smithi172:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-16T07:24:40.367 DEBUG:teuthology.orchestra.run.smithi172:> sudo shutdown -r now 2024-09-16T07:25:02.394 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-16T07:25:02.394 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi121.front.sepia.ceph.com' 2024-09-16T07:25:02.396 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T07:25:10.377 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2024-09-16T07:25:10.378 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-09-16T07:25:10.379 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T07:25:20.833 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.121 2024-09-16T07:25:28.765 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-09-16T07:25:29.835 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi121.front.sepia.ceph.com' 2024-09-16T07:25:29.836 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T07:25:32.893 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.121 2024-09-16T07:25:37.769 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-09-16T07:25:37.770 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T07:25:40.829 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-09-16T07:25:44.895 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi121.front.sepia.ceph.com' 2024-09-16T07:25:44.896 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T07:25:52.849 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-09-16T07:25:52.849 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T07:26:11.265 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-09-16T07:26:16.762 DEBUG:teuthology.orchestra.run.smithi121:> true 2024-09-16T07:26:17.226 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi121.front.sepia.ceph.com' 2024-09-16T07:26:17.227 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-16T07:26:17.227 DEBUG:teuthology.orchestra.run.smithi121:> uname -r 2024-09-16T07:26:17.245 INFO:teuthology.orchestra.run.smithi121.stdout:5.14.0-505.el9.x86_64 2024-09-16T07:26:17.245 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-16T07:26:17.245 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-16T07:26:17.245 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-16T07:26:18.246 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-16T07:26:18.246 DEBUG:teuthology.orchestra.run.smithi121:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-16T07:26:18.311 INFO:teuthology.orchestra.run.smithi121.stdout:ttyS1 2024-09-16T07:26:18.335 DEBUG:teuthology.parallel:result is None 2024-09-16T07:26:26.266 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-09-16T07:26:26.267 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T07:26:26.622 DEBUG:teuthology.orchestra.run.smithi172:> true 2024-09-16T07:26:26.981 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-09-16T07:26:26.981 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.14.0-505.el9.x86_64"... 2024-09-16T07:26:26.982 DEBUG:teuthology.orchestra.run.smithi172:> uname -r 2024-09-16T07:26:26.996 INFO:teuthology.orchestra.run.smithi172.stdout:5.14.0-505.el9.x86_64 2024-09-16T07:26:26.996 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-16T07:26:26.996 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-16T07:26:26.997 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-16T07:26:27.997 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-09-16T07:26:27.997 DEBUG:teuthology.orchestra.run.smithi172:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-16T07:26:28.077 INFO:teuthology.orchestra.run.smithi172.stdout:ttyS1 2024-09-16T07:26:28.100 DEBUG:teuthology.parallel:result is None 2024-09-16T07:26:28.100 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-16T07:26:28.108 INFO:teuthology.task.internal:Creating test directory... 2024-09-16T07:26:28.108 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-16T07:26:28.111 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-16T07:26:28.127 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-16T07:26:28.244 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-16T07:26:28.256 INFO:teuthology.task.internal:Creating archive directory... 2024-09-16T07:26:28.256 DEBUG:teuthology.orchestra.run.smithi121:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-16T07:26:28.259 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-16T07:26:28.394 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-16T07:26:28.401 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-16T07:26:28.401 DEBUG:teuthology.orchestra.run.smithi121:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-16T07:26:28.403 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-16T07:26:28.429 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T07:26:28.436 INFO:teuthology.orchestra.run.smithi121.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T07:26:28.440 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T07:26:28.448 INFO:teuthology.orchestra.run.smithi121.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T07:26:28.449 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-16T07:26:28.456 INFO:teuthology.task.internal:Configuring sudo... 2024-09-16T07:26:28.456 DEBUG:teuthology.orchestra.run.smithi121:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-16T07:26:28.492 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-16T07:26:28.517 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-16T07:26:28.527 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-16T07:26:28.527 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-16T07:26:28.560 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-16T07:26:28.575 DEBUG:teuthology.orchestra.run.smithi121:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T07:26:28.662 DEBUG:teuthology.orchestra.run.smithi121:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T07:26:28.711 DEBUG:teuthology.orchestra.run.smithi121:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T07:26:28.794 DEBUG:teuthology.orchestra.run.smithi121:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T07:26:28.835 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-16T07:26:28.835 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-16T07:26:28.900 DEBUG:teuthology.orchestra.run.smithi172:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T07:26:28.941 DEBUG:teuthology.orchestra.run.smithi172:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T07:26:28.985 DEBUG:teuthology.orchestra.run.smithi172:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T07:26:29.064 DEBUG:teuthology.orchestra.run.smithi172:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T07:26:29.108 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-16T07:26:29.108 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-16T07:26:29.173 DEBUG:teuthology.orchestra.run.smithi121:> sudo service rsyslog restart 2024-09-16T07:26:29.176 DEBUG:teuthology.orchestra.run.smithi172:> sudo service rsyslog restart 2024-09-16T07:26:29.227 INFO:teuthology.orchestra.run.smithi121.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T07:26:29.257 INFO:teuthology.orchestra.run.smithi172.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T07:26:29.789 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-16T07:26:29.796 INFO:teuthology.task.internal:Starting timer... 2024-09-16T07:26:29.796 INFO:teuthology.run_tasks:Running task pcp... 2024-09-16T07:26:29.808 INFO:teuthology.run_tasks:Running task selinux... 2024-09-16T07:26:29.817 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-09-16T07:26:29.817 DEBUG:teuthology.orchestra.run.smithi121:> sudo service auditd rotate 2024-09-16T07:26:29.861 INFO:teuthology.orchestra.run.smithi121.stdout:Rotating logs: 2024-09-16T07:26:29.863 DEBUG:teuthology.orchestra.run.smithi172:> sudo service auditd rotate 2024-09-16T07:26:29.937 INFO:teuthology.orchestra.run.smithi172.stdout:Rotating logs: 2024-09-16T07:26:29.939 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-16T07:26:29.940 DEBUG:teuthology.orchestra.run.smithi121:> /usr/sbin/getenforce 2024-09-16T07:26:29.980 INFO:teuthology.orchestra.run.smithi121.stdout:Permissive 2024-09-16T07:26:29.980 DEBUG:teuthology.orchestra.run.smithi172:> /usr/sbin/getenforce 2024-09-16T07:26:30.015 INFO:teuthology.orchestra.run.smithi172.stdout:Permissive 2024-09-16T07:26:30.015 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi121.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi172.front.sepia.ceph.com': 'permissive'} 2024-09-16T07:26:30.015 DEBUG:teuthology.orchestra.run.smithi121:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-16T07:26:30.045 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T07:26:30.046 DEBUG:teuthology.orchestra.run.smithi172:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-16T07:26:30.079 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T07:26:30.079 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-16T07:26:30.080 DEBUG:teuthology.orchestra.run.smithi121:> sudo /usr/sbin/setenforce permissive 2024-09-16T07:26:30.114 DEBUG:teuthology.orchestra.run.smithi172:> sudo /usr/sbin/setenforce permissive 2024-09-16T07:26:30.151 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-16T07:26:30.164 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-16T07:26:30.167 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-16T07:26:30.282 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-16T07:26:30.295 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-16T07:26:30.296 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi121.front.sepia.ceph.com,smithi172.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-16T07:30:16.659 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi121.front.sepia.ceph.com'), Remote(name='ubuntu@smithi172.front.sepia.ceph.com')] 2024-09-16T07:30:16.661 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi121.front.sepia.ceph.com' 2024-09-16T07:30:16.662 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T07:30:16.743 DEBUG:teuthology.orchestra.run.smithi121:> true 2024-09-16T07:30:16.821 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi121.front.sepia.ceph.com' 2024-09-16T07:30:16.821 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-09-16T07:30:16.822 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T07:30:16.896 DEBUG:teuthology.orchestra.run.smithi172:> true 2024-09-16T07:30:16.983 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-09-16T07:30:16.984 INFO:teuthology.run_tasks:Running task clock... 2024-09-16T07:30:16.993 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-16T07:30:16.993 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-16T07:30:16.994 DEBUG:teuthology.orchestra.run.smithi121:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T07:30:16.996 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-16T07:30:16.996 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T07:30:17.024 INFO:teuthology.orchestra.run.smithi121.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-16T07:30:17.039 INFO:teuthology.orchestra.run.smithi121.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-16T07:30:17.053 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-16T07:30:17.064 INFO:teuthology.orchestra.run.smithi121.stderr:sudo: ntpd: command not found 2024-09-16T07:30:17.067 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-16T07:30:17.076 INFO:teuthology.orchestra.run.smithi121.stdout:506 Cannot talk to daemon 2024-09-16T07:30:17.090 INFO:teuthology.orchestra.run.smithi121.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-16T07:30:17.092 INFO:teuthology.orchestra.run.smithi172.stderr:sudo: ntpd: command not found 2024-09-16T07:30:17.103 INFO:teuthology.orchestra.run.smithi172.stdout:506 Cannot talk to daemon 2024-09-16T07:30:17.105 INFO:teuthology.orchestra.run.smithi121.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-16T07:30:17.118 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-16T07:30:17.132 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-16T07:30:17.166 INFO:teuthology.orchestra.run.smithi121.stderr:bash: line 1: ntpq: command not found 2024-09-16T07:30:17.169 INFO:teuthology.orchestra.run.smithi121.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T07:30:17.169 INFO:teuthology.orchestra.run.smithi121.stdout:=============================================================================== 2024-09-16T07:30:17.170 INFO:teuthology.orchestra.run.smithi121.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T07:30:17.170 INFO:teuthology.orchestra.run.smithi121.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T07:30:17.170 INFO:teuthology.orchestra.run.smithi121.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T07:30:17.170 INFO:teuthology.orchestra.run.smithi121.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T07:30:17.191 INFO:teuthology.orchestra.run.smithi172.stderr:bash: line 1: ntpq: command not found 2024-09-16T07:30:17.195 INFO:teuthology.orchestra.run.smithi172.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T07:30:17.195 INFO:teuthology.orchestra.run.smithi172.stdout:=============================================================================== 2024-09-16T07:30:17.195 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T07:30:17.195 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T07:30:17.195 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T07:30:17.195 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T07:30:17.196 INFO:teuthology.run_tasks:Running task install... 2024-09-16T07:30:17.204 DEBUG:teuthology.task.install:project ceph 2024-09-16T07:30:17.204 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'crimson', 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5'}} 2024-09-16T07:30:17.204 DEBUG:teuthology.task.install:config {'flavor': 'crimson', 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5'} 2024-09-16T07:30:17.204 INFO:teuthology.task.install:Using flavor: crimson 2024-09-16T07:30:17.209 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-16T07:30:17.209 INFO:teuthology.task.install:extra packages: [] 2024-09-16T07:30:17.210 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'crimson', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5', 'tag': None, 'wait_for_package': False} 2024-09-16T07:30:17.211 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=81fedcb3b484c843d22ffbc8d179cb567b7083b5 2024-09-16T07:30:17.213 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'crimson', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5', 'tag': None, 'wait_for_package': False} 2024-09-16T07:30:17.213 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=81fedcb3b484c843d22ffbc8d179cb567b7083b5 2024-09-16T07:30:17.358 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/ 2024-09-16T07:30:17.359 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4879.g81fedcb3 2024-09-16T07:30:17.373 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/ 2024-09-16T07:30:17.374 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4879.g81fedcb3 2024-09-16T07:30:17.469 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-16T07:30:17.470 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-16T07:30:17.470 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-16T07:30:17.482 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-16T07:30:17.482 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-16T07:30:17.482 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-16T07:30:17.496 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-16T07:30:17.496 DEBUG:teuthology.orchestra.run.smithi121:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/81fedcb3b484c843d22ffbc8d179cb567b7083b5/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-16T07:30:17.509 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-16T07:30:17.509 DEBUG:teuthology.orchestra.run.smithi172:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/81fedcb3b484c843d22ffbc8d179cb567b7083b5/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-16T07:30:17.561 DEBUG:teuthology.orchestra.run.smithi121:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-16T07:30:17.574 DEBUG:teuthology.orchestra.run.smithi172:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-16T07:30:17.635 DEBUG:teuthology.orchestra.run.smithi121:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-16T07:30:17.650 DEBUG:teuthology.orchestra.run.smithi172:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-16T07:30:17.699 INFO:teuthology.orchestra.run.smithi121.stdout:check_obsoletes = 1 2024-09-16T07:30:17.701 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum clean all 2024-09-16T07:30:17.713 INFO:teuthology.orchestra.run.smithi172.stdout:check_obsoletes = 1 2024-09-16T07:30:17.715 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum clean all 2024-09-16T07:30:17.925 INFO:teuthology.orchestra.run.smithi121.stdout:45 files removed 2024-09-16T07:30:17.947 INFO:teuthology.orchestra.run.smithi172.stdout:45 files removed 2024-09-16T07:30:17.951 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install ceph-radosgw 2024-09-16T07:30:17.974 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-radosgw 2024-09-16T07:30:18.520 INFO:teuthology.orchestra.run.smithi121.stdout:ceph packages for x86_64 312 kB/s | 88 kB 00:00 2024-09-16T07:30:18.526 INFO:teuthology.orchestra.run.smithi172.stdout:ceph packages for x86_64 333 kB/s | 88 kB 00:00 2024-09-16T07:30:18.812 INFO:teuthology.orchestra.run.smithi121.stdout:ceph noarch packages 97 kB/s | 24 kB 00:00 2024-09-16T07:30:18.818 INFO:teuthology.orchestra.run.smithi172.stdout:ceph noarch packages 97 kB/s | 24 kB 00:00 2024-09-16T07:30:19.088 INFO:teuthology.orchestra.run.smithi121.stdout:ceph source packages 8.7 kB/s | 2.1 kB 00:00 2024-09-16T07:30:19.094 INFO:teuthology.orchestra.run.smithi172.stdout:ceph source packages 8.7 kB/s | 2.1 kB 00:00 2024-09-16T07:30:21.970 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - BaseOS 2.9 MB/s | 8.2 MB 00:02 2024-09-16T07:30:22.272 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - BaseOS 2.6 MB/s | 8.2 MB 00:03 2024-09-16T07:30:27.521 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - AppStream 4.6 MB/s | 20 MB 00:04 2024-09-16T07:30:28.311 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - AppStream 4.1 MB/s | 20 MB 00:04 2024-09-16T07:30:32.512 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - CRB 16 MB/s | 6.5 MB 00:00 2024-09-16T07:30:33.971 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - Extras packages 83 kB/s | 19 kB 00:00 2024-09-16T07:30:34.788 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - CRB 1.9 MB/s | 6.5 MB 00:03 2024-09-16T07:30:34.883 INFO:teuthology.orchestra.run.smithi172.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-16T07:30:36.222 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - Extras packages 103 kB/s | 19 kB 00:00 2024-09-16T07:30:37.059 INFO:teuthology.orchestra.run.smithi121.stdout:Extra Packages for Enterprise Linux 32 MB/s | 23 MB 00:00 2024-09-16T07:30:40.297 INFO:teuthology.orchestra.run.smithi172.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-16T07:30:42.431 INFO:teuthology.orchestra.run.smithi121.stdout:lab-extras 34 kB/s | 1.7 kB 00:00 2024-09-16T07:30:42.690 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-16T07:30:42.708 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T07:30:42.708 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repository Size 2024-09-16T07:30:42.708 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T07:30:42.708 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-09-16T07:30:42.708 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-radosgw x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 10 M 2024-09-16T07:30:42.708 INFO:teuthology.orchestra.run.smithi172.stdout:Upgrading: 2024-09-16T07:30:42.708 INFO:teuthology.orchestra.run.smithi172.stdout: librados2 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 3.5 M 2024-09-16T07:30:42.708 INFO:teuthology.orchestra.run.smithi172.stdout: librbd1 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 3.8 M 2024-09-16T07:30:42.708 INFO:teuthology.orchestra.run.smithi172.stdout:Installing dependencies: 2024-09-16T07:30:42.709 INFO:teuthology.orchestra.run.smithi172.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-16T07:30:42.709 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-base x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 6.1 M 2024-09-16T07:30:42.709 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-common x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 20 M 2024-09-16T07:30:42.709 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-selinux x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 25 k 2024-09-16T07:30:42.709 INFO:teuthology.orchestra.run.smithi172.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-16T07:30:42.709 INFO:teuthology.orchestra.run.smithi172.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-16T07:30:42.709 INFO:teuthology.orchestra.run.smithi172.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-16T07:30:42.709 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs2 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 809 k 2024-09-16T07:30:42.709 INFO:teuthology.orchestra.run.smithi172.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-16T07:30:42.709 INFO:teuthology.orchestra.run.smithi172.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-16T07:30:42.709 INFO:teuthology.orchestra.run.smithi172.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-16T07:30:42.710 INFO:teuthology.orchestra.run.smithi172.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-16T07:30:42.710 INFO:teuthology.orchestra.run.smithi172.stdout: libradosstriper1 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 558 k 2024-09-16T07:30:42.710 INFO:teuthology.orchestra.run.smithi172.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-16T07:30:42.710 INFO:teuthology.orchestra.run.smithi172.stdout: librgw2 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 5.4 M 2024-09-16T07:30:42.710 INFO:teuthology.orchestra.run.smithi172.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-16T07:30:42.710 INFO:teuthology.orchestra.run.smithi172.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-16T07:30:42.710 INFO:teuthology.orchestra.run.smithi172.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-16T07:30:42.710 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-argparse x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 45 k 2024-09-16T07:30:42.710 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-common x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 143 k 2024-09-16T07:30:42.710 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cephfs x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 160 k 2024-09-16T07:30:42.710 INFO:teuthology.orchestra.run.smithi172.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-16T07:30:42.710 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rados x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 315 k 2024-09-16T07:30:42.710 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rbd x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 302 k 2024-09-16T07:30:42.710 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rgw x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 99 k 2024-09-16T07:30:42.711 INFO:teuthology.orchestra.run.smithi172.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-16T07:30:42.711 INFO:teuthology.orchestra.run.smithi172.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-16T07:30:42.711 INFO:teuthology.orchestra.run.smithi172.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-16T07:30:42.711 INFO:teuthology.orchestra.run.smithi172.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-16T07:30:42.711 INFO:teuthology.orchestra.run.smithi172.stdout:Installing weak dependencies: 2024-09-16T07:30:42.711 INFO:teuthology.orchestra.run.smithi172.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-16T07:30:42.711 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:30:42.711 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-09-16T07:30:42.711 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T07:30:42.711 INFO:teuthology.orchestra.run.smithi172.stdout:Install 31 Packages 2024-09-16T07:30:42.711 INFO:teuthology.orchestra.run.smithi172.stdout:Upgrade 2 Packages 2024-09-16T07:30:42.711 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:30:42.712 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 60 M 2024-09-16T07:30:42.712 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-09-16T07:30:43.674 INFO:teuthology.orchestra.run.smithi172.stdout:(1/33): ceph-base-19.3.0-4879.g81fedcb3.el9.x86 11 MB/s | 6.1 MB 00:00 2024-09-16T07:30:43.732 INFO:teuthology.orchestra.run.smithi172.stdout:(2/33): ceph-selinux-19.3.0-4879.g81fedcb3.el9. 431 kB/s | 25 kB 00:00 2024-09-16T07:30:43.841 INFO:teuthology.orchestra.run.smithi172.stdout:(3/33): ceph-radosgw-19.3.0-4879.g81fedcb3.el9. 15 MB/s | 10 MB 00:00 2024-09-16T07:30:43.883 INFO:teuthology.orchestra.run.smithi172.stdout:(4/33): libcephfs2-19.3.0-4879.g81fedcb3.el9.x8 5.3 MB/s | 809 kB 00:00 2024-09-16T07:30:43.925 INFO:teuthology.orchestra.run.smithi172.stdout:(5/33): libradosstriper1-19.3.0-4879.g81fedcb3. 6.5 MB/s | 558 kB 00:00 2024-09-16T07:30:44.009 INFO:teuthology.orchestra.run.smithi172.stdout:(6/33): python3-ceph-argparse-19.3.0-4879.g81fe 541 kB/s | 45 kB 00:00 2024-09-16T07:30:44.109 INFO:teuthology.orchestra.run.smithi172.stdout:(7/33): librgw2-19.3.0-4879.g81fedcb3.el9.x86_6 24 MB/s | 5.4 MB 00:00 2024-09-16T07:30:44.134 INFO:teuthology.orchestra.run.smithi172.stdout:(8/33): python3-ceph-common-19.3.0-4879.g81fedc 1.1 MB/s | 143 kB 00:00 2024-09-16T07:30:44.159 INFO:teuthology.orchestra.run.smithi172.stdout:(9/33): python3-cephfs-19.3.0-4879.g81fedcb3.el 3.1 MB/s | 160 kB 00:00 2024-09-16T07:30:44.206 INFO:teuthology.orchestra.run.smithi172.stdout:(10/33): python3-rados-19.3.0-4879.g81fedcb3.el 4.3 MB/s | 315 kB 00:00 2024-09-16T07:30:44.235 INFO:teuthology.orchestra.run.smithi172.stdout:(11/33): python3-rbd-19.3.0-4879.g81fedcb3.el9. 3.9 MB/s | 302 kB 00:00 2024-09-16T07:30:44.260 INFO:teuthology.orchestra.run.smithi172.stdout:(12/33): python3-rgw-19.3.0-4879.g81fedcb3.el9. 1.8 MB/s | 99 kB 00:00 2024-09-16T07:30:44.477 INFO:teuthology.orchestra.run.smithi172.stdout:(13/33): ceph-common-19.3.0-4879.g81fedcb3.el9. 15 MB/s | 20 MB 00:01 2024-09-16T07:30:44.536 INFO:teuthology.orchestra.run.smithi172.stdout:(14/33): boost-program-options-1.75.0-8.el9.x86 355 kB/s | 107 kB 00:00 2024-09-16T07:30:44.561 INFO:teuthology.orchestra.run.smithi172.stdout:(15/33): libnbd-1.20.2-2.el9.x86_64.rpm 567 kB/s | 171 kB 00:00 2024-09-16T07:30:44.586 INFO:teuthology.orchestra.run.smithi172.stdout:(16/33): librabbitmq-0.11.0-7.el9.x86_64.rpm 899 kB/s | 45 kB 00:00 2024-09-16T07:30:44.611 INFO:teuthology.orchestra.run.smithi172.stdout:(17/33): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.2 MB/s | 160 kB 00:00 2024-09-16T07:30:44.653 INFO:teuthology.orchestra.run.smithi172.stdout:(18/33): librdkafka-1.6.1-102.el9.x86_64.rpm 7.0 MB/s | 662 kB 00:00 2024-09-16T07:30:44.679 INFO:teuthology.orchestra.run.smithi172.stdout:(19/33): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.1 MB/s | 292 kB 00:00 2024-09-16T07:30:44.695 INFO:teuthology.orchestra.run.smithi172.stdout:(20/33): python3-prettytable-0.7.2-27.el9.noarc 504 kB/s | 42 kB 00:00 2024-09-16T07:30:44.713 INFO:teuthology.orchestra.run.smithi172.stdout:(21/33): qatlib-service-24.02.0-1.el9.x86_64.rp 1.0 MB/s | 36 kB 00:00 2024-09-16T07:30:44.730 INFO:teuthology.orchestra.run.smithi172.stdout:(22/33): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2024-09-16T07:30:44.755 INFO:teuthology.orchestra.run.smithi172.stdout:(23/33): qatlib-24.02.0-1.el9.x86_64.rpm 2.1 MB/s | 221 kB 00:00 2024-09-16T07:30:44.822 INFO:teuthology.orchestra.run.smithi172.stdout:(24/33): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.8 MB/s | 308 kB 00:00 2024-09-16T07:30:44.840 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2024-09-16T07:30:44.847 INFO:teuthology.orchestra.run.smithi172.stdout:(25/33): libarrow-doc-9.0.0-11.el9.noarch.rpm 333 kB/s | 26 kB 00:00 2024-09-16T07:30:44.849 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-09-16T07:30:44.849 INFO:teuthology.orchestra.run.smithi121.stdout: Package Arch Version Repository Size 2024-09-16T07:30:44.849 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-09-16T07:30:44.849 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2024-09-16T07:30:44.849 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-radosgw x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 10 M 2024-09-16T07:30:44.849 INFO:teuthology.orchestra.run.smithi121.stdout:Upgrading: 2024-09-16T07:30:44.850 INFO:teuthology.orchestra.run.smithi121.stdout: librados2 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 3.5 M 2024-09-16T07:30:44.850 INFO:teuthology.orchestra.run.smithi121.stdout: librbd1 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 3.8 M 2024-09-16T07:30:44.850 INFO:teuthology.orchestra.run.smithi121.stdout:Installing dependencies: 2024-09-16T07:30:44.850 INFO:teuthology.orchestra.run.smithi121.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-16T07:30:44.850 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-base x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 6.1 M 2024-09-16T07:30:44.850 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-common x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 20 M 2024-09-16T07:30:44.850 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-selinux x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 25 k 2024-09-16T07:30:44.850 INFO:teuthology.orchestra.run.smithi121.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-16T07:30:44.850 INFO:teuthology.orchestra.run.smithi121.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-16T07:30:44.850 INFO:teuthology.orchestra.run.smithi121.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-16T07:30:44.850 INFO:teuthology.orchestra.run.smithi121.stdout: libcephfs2 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 809 k 2024-09-16T07:30:44.850 INFO:teuthology.orchestra.run.smithi121.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-16T07:30:44.851 INFO:teuthology.orchestra.run.smithi121.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-16T07:30:44.851 INFO:teuthology.orchestra.run.smithi121.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-16T07:30:44.851 INFO:teuthology.orchestra.run.smithi121.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-16T07:30:44.851 INFO:teuthology.orchestra.run.smithi121.stdout: libradosstriper1 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 558 k 2024-09-16T07:30:44.851 INFO:teuthology.orchestra.run.smithi121.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-16T07:30:44.851 INFO:teuthology.orchestra.run.smithi121.stdout: librgw2 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 5.4 M 2024-09-16T07:30:44.851 INFO:teuthology.orchestra.run.smithi121.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-16T07:30:44.851 INFO:teuthology.orchestra.run.smithi121.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-16T07:30:44.851 INFO:teuthology.orchestra.run.smithi121.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-16T07:30:44.851 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ceph-argparse x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 45 k 2024-09-16T07:30:44.851 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ceph-common x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 143 k 2024-09-16T07:30:44.851 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cephfs x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 160 k 2024-09-16T07:30:44.852 INFO:teuthology.orchestra.run.smithi121.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-16T07:30:44.852 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rados x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 315 k 2024-09-16T07:30:44.852 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rbd x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 302 k 2024-09-16T07:30:44.852 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rgw x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 99 k 2024-09-16T07:30:44.852 INFO:teuthology.orchestra.run.smithi121.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-16T07:30:44.852 INFO:teuthology.orchestra.run.smithi121.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-16T07:30:44.852 INFO:teuthology.orchestra.run.smithi121.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-16T07:30:44.852 INFO:teuthology.orchestra.run.smithi121.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-16T07:30:44.852 INFO:teuthology.orchestra.run.smithi121.stdout:Installing weak dependencies: 2024-09-16T07:30:44.852 INFO:teuthology.orchestra.run.smithi121.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-16T07:30:44.852 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:30:44.852 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2024-09-16T07:30:44.852 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-09-16T07:30:44.853 INFO:teuthology.orchestra.run.smithi121.stdout:Install 31 Packages 2024-09-16T07:30:44.853 INFO:teuthology.orchestra.run.smithi121.stdout:Upgrade 2 Packages 2024-09-16T07:30:44.853 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:30:44.853 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 60 M 2024-09-16T07:30:44.853 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading Packages: 2024-09-16T07:30:44.872 INFO:teuthology.orchestra.run.smithi172.stdout:(26/33): liboath-2.6.7-2.el9.x86_64.rpm 967 kB/s | 49 kB 00:00 2024-09-16T07:30:44.897 INFO:teuthology.orchestra.run.smithi172.stdout:(27/33): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-16T07:30:44.931 INFO:teuthology.orchestra.run.smithi172.stdout:(28/33): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-16T07:30:44.973 INFO:teuthology.orchestra.run.smithi172.stdout:(29/33): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.2 MB/s | 839 kB 00:00 2024-09-16T07:30:45.032 INFO:teuthology.orchestra.run.smithi172.stdout:(30/33): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-16T07:30:45.124 INFO:teuthology.orchestra.run.smithi172.stdout:(31/33): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-09-16T07:30:45.256 INFO:teuthology.orchestra.run.smithi172.stdout:(32/33): librados2-19.3.0-4879.g81fedcb3.el9.x8 12 MB/s | 3.5 MB 00:00 2024-09-16T07:30:45.341 INFO:teuthology.orchestra.run.smithi172.stdout:(33/33): librbd1-19.3.0-4879.g81fedcb3.el9.x86_ 12 MB/s | 3.8 MB 00:00 2024-09-16T07:30:45.345 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:30:45.345 INFO:teuthology.orchestra.run.smithi172.stdout:Total 23 MB/s | 60 MB 00:02 2024-09-16T07:30:45.458 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-09-16T07:30:45.495 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-09-16T07:30:45.495 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-09-16T07:30:45.583 INFO:teuthology.orchestra.run.smithi121.stdout:(1/33): ceph-base-19.3.0-4879.g81fedcb3.el9.x86 12 MB/s | 6.1 MB 00:00 2024-09-16T07:30:45.633 INFO:teuthology.orchestra.run.smithi121.stdout:(2/33): ceph-selinux-19.3.0-4879.g81fedcb3.el9. 504 kB/s | 25 kB 00:00 2024-09-16T07:30:45.725 INFO:teuthology.orchestra.run.smithi121.stdout:(3/33): libcephfs2-19.3.0-4879.g81fedcb3.el9.x8 8.6 MB/s | 809 kB 00:00 2024-09-16T07:30:45.816 INFO:teuthology.orchestra.run.smithi121.stdout:(4/33): libradosstriper1-19.3.0-4879.g81fedcb3. 6.0 MB/s | 558 kB 00:00 2024-09-16T07:30:46.025 INFO:teuthology.orchestra.run.smithi121.stdout:(5/33): ceph-common-19.3.0-4879.g81fedcb3.el9.x 21 MB/s | 20 MB 00:00 2024-09-16T07:30:46.075 INFO:teuthology.orchestra.run.smithi121.stdout:(6/33): python3-ceph-argparse-19.3.0-4879.g81fe 906 kB/s | 45 kB 00:00 2024-09-16T07:30:46.150 INFO:teuthology.orchestra.run.smithi121.stdout:(7/33): librgw2-19.3.0-4879.g81fedcb3.el9.x86_6 16 MB/s | 5.4 MB 00:00 2024-09-16T07:30:46.176 INFO:teuthology.orchestra.run.smithi121.stdout:(8/33): python3-ceph-common-19.3.0-4879.g81fedc 1.4 MB/s | 143 kB 00:00 2024-09-16T07:30:46.179 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-09-16T07:30:46.180 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-09-16T07:30:46.201 INFO:teuthology.orchestra.run.smithi121.stdout:(9/33): python3-cephfs-19.3.0-4879.g81fedcb3.el 3.1 MB/s | 160 kB 00:00 2024-09-16T07:30:46.234 INFO:teuthology.orchestra.run.smithi121.stdout:(10/33): python3-rados-19.3.0-4879.g81fedcb3.el 5.3 MB/s | 315 kB 00:00 2024-09-16T07:30:46.260 INFO:teuthology.orchestra.run.smithi121.stdout:(11/33): python3-rbd-19.3.0-4879.g81fedcb3.el9. 5.0 MB/s | 302 kB 00:00 2024-09-16T07:30:46.285 INFO:teuthology.orchestra.run.smithi121.stdout:(12/33): python3-rgw-19.3.0-4879.g81fedcb3.el9. 1.9 MB/s | 99 kB 00:00 2024-09-16T07:30:46.386 INFO:teuthology.orchestra.run.smithi121.stdout:(13/33): boost-program-options-1.75.0-8.el9.x86 853 kB/s | 107 kB 00:00 2024-09-16T07:30:46.411 INFO:teuthology.orchestra.run.smithi121.stdout:(14/33): libnbd-1.20.2-2.el9.x86_64.rpm 1.3 MB/s | 171 kB 00:00 2024-09-16T07:30:46.445 INFO:teuthology.orchestra.run.smithi121.stdout:(15/33): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-09-16T07:30:46.461 INFO:teuthology.orchestra.run.smithi121.stdout:(16/33): librabbitmq-0.11.0-7.el9.x86_64.rpm 901 kB/s | 45 kB 00:00 2024-09-16T07:30:46.545 INFO:teuthology.orchestra.run.smithi121.stdout:(17/33): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-09-16T07:30:46.570 INFO:teuthology.orchestra.run.smithi121.stdout:(18/33): librdkafka-1.6.1-102.el9.x86_64.rpm 5.2 MB/s | 662 kB 00:00 2024-09-16T07:30:46.587 INFO:teuthology.orchestra.run.smithi121.stdout:(19/33): python3-prettytable-0.7.2-27.el9.noarc 1.0 MB/s | 42 kB 00:00 2024-09-16T07:30:46.613 INFO:teuthology.orchestra.run.smithi121.stdout:(20/33): qatlib-24.02.0-1.el9.x86_64.rpm 5.1 MB/s | 221 kB 00:00 2024-09-16T07:30:46.630 INFO:teuthology.orchestra.run.smithi121.stdout:(21/33): qatlib-service-24.02.0-1.el9.x86_64.rp 854 kB/s | 36 kB 00:00 2024-09-16T07:30:46.647 INFO:teuthology.orchestra.run.smithi121.stdout:(22/33): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2024-09-16T07:30:46.697 INFO:teuthology.orchestra.run.smithi121.stdout:(23/33): gperftools-libs-2.9.1-3.el9.x86_64.rpm 4.5 MB/s | 308 kB 00:00 2024-09-16T07:30:46.714 INFO:teuthology.orchestra.run.smithi121.stdout:(24/33): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.7 MB/s | 26 kB 00:00 2024-09-16T07:30:46.731 INFO:teuthology.orchestra.run.smithi121.stdout:(25/33): liboath-2.6.7-2.el9.x86_64.rpm 2.8 MB/s | 49 kB 00:00 2024-09-16T07:30:46.756 INFO:teuthology.orchestra.run.smithi121.stdout:(26/33): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-16T07:30:46.806 INFO:teuthology.orchestra.run.smithi121.stdout:(27/33): parquet-libs-9.0.0-11.el9.x86_64.rpm 16 MB/s | 839 kB 00:00 2024-09-16T07:30:46.840 INFO:teuthology.orchestra.run.smithi121.stdout:(28/33): re2-20211101-20.el9.x86_64.rpm 5.7 MB/s | 191 kB 00:00 2024-09-16T07:30:46.949 INFO:teuthology.orchestra.run.smithi121.stdout:(29/33): ceph-radosgw-19.3.0-4879.g81fedcb3.el9 5.5 MB/s | 10 MB 00:01 2024-09-16T07:30:47.024 INFO:teuthology.orchestra.run.smithi121.stdout:(30/33): thrift-0.15.0-2.el9.x86_64.rpm 8.6 MB/s | 1.6 MB 00:00 2024-09-16T07:30:47.091 INFO:teuthology.orchestra.run.smithi121.stdout:(31/33): libarrow-9.0.0-11.el9.x86_64.rpm 9.9 MB/s | 4.4 MB 00:00 2024-09-16T07:30:47.191 INFO:teuthology.orchestra.run.smithi121.stdout:(32/33): librados2-19.3.0-4879.g81fedcb3.el9.x8 14 MB/s | 3.5 MB 00:00 2024-09-16T07:30:47.283 INFO:teuthology.orchestra.run.smithi121.stdout:(33/33): librbd1-19.3.0-4879.g81fedcb3.el9.x86_ 15 MB/s | 3.8 MB 00:00 2024-09-16T07:30:47.287 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:30:47.288 INFO:teuthology.orchestra.run.smithi121.stdout:Total 25 MB/s | 60 MB 00:02 2024-09-16T07:30:47.401 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2024-09-16T07:30:47.437 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction check succeeded. 2024-09-16T07:30:47.437 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2024-09-16T07:30:47.693 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-09-16T07:30:48.147 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded. 2024-09-16T07:30:48.148 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2024-09-16T07:30:48.224 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/35 2024-09-16T07:30:48.268 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/35 2024-09-16T07:30:48.360 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/35 2024-09-16T07:30:48.457 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 3/35 2024-09-16T07:30:48.494 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/35 2024-09-16T07:30:48.557 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/35 2024-09-16T07:30:48.603 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : liboath-2.6.7-2.el9.x86_64 5/35 2024-09-16T07:30:48.641 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/35 2024-09-16T07:30:48.666 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/35 2024-09-16T07:30:48.689 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-16T07:30:48.718 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-16T07:30:48.923 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-16T07:30:48.955 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-16T07:30:48.990 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/35 2024-09-16T07:30:49.034 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-ceph-argparse-2:19.3.0-4879.g81fedcb3.el9. 11/35 2024-09-16T07:30:49.063 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 12/35 2024-09-16T07:30:49.150 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 13/35 2024-09-16T07:30:49.177 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_6 14/35 2024-09-16T07:30:49.264 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_6 14/35 2024-09-16T07:30:49.301 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : thrift-0.15.0-2.el9.x86_64 15/35 2024-09-16T07:30:49.412 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : re2-1:20211101-20.el9.x86_64 16/35 2024-09-16T07:30:49.454 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/35 2024-09-16T07:30:49.503 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 18/35 2024-09-16T07:30:49.533 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 19/35 2024-09-16T07:30:49.563 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 20/35 2024-09-16T07:30:49.599 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 21/35 2024-09-16T07:30:49.786 INFO:teuthology.orchestra.run.smithi121.stdout: Preparing : 1/1 2024-09-16T07:30:49.963 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 22/35 2024-09-16T07:30:50.025 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 23/35 2024-09-16T07:30:50.116 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 23/35 2024-09-16T07:30:50.147 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 24/35 2024-09-16T07:30:50.190 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 25/35 2024-09-16T07:30:50.305 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/35 2024-09-16T07:30:50.360 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/35 2024-09-16T07:30:50.451 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/35 2024-09-16T07:30:50.541 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 3/35 2024-09-16T07:30:50.570 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/35 2024-09-16T07:30:50.633 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/35 2024-09-16T07:30:50.678 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : liboath-2.6.7-2.el9.x86_64 5/35 2024-09-16T07:30:50.716 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/35 2024-09-16T07:30:50.741 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/35 2024-09-16T07:30:50.764 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-16T07:30:50.783 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 26/35 2024-09-16T07:30:50.794 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-16T07:30:50.819 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 27/35 2024-09-16T07:30:50.891 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 27/35 2024-09-16T07:30:50.951 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-16T07:30:50.969 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 28/35 2024-09-16T07:30:50.981 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-16T07:30:51.021 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-ceph-common-2:19.3.0-4879.g81fedcb3.el9.x8 29/35 2024-09-16T07:30:51.024 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/35 2024-09-16T07:30:51.067 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-ceph-argparse-2:19.3.0-4879.g81fedcb3.el9. 11/35 2024-09-16T07:30:51.096 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 12/35 2024-09-16T07:30:51.178 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 13/35 2024-09-16T07:30:51.202 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_6 14/35 2024-09-16T07:30:51.290 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_6 14/35 2024-09-16T07:30:51.326 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : thrift-0.15.0-2.el9.x86_64 15/35 2024-09-16T07:30:51.437 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : re2-1:20211101-20.el9.x86_64 16/35 2024-09-16T07:30:51.474 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/35 2024-09-16T07:30:51.510 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 18/35 2024-09-16T07:30:51.551 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 19/35 2024-09-16T07:30:51.580 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 20/35 2024-09-16T07:30:51.625 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 21/35 2024-09-16T07:30:51.983 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 22/35 2024-09-16T07:30:52.034 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 23/35 2024-09-16T07:30:52.125 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 23/35 2024-09-16T07:30:52.156 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 24/35 2024-09-16T07:30:52.191 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 25/35 2024-09-16T07:30:52.777 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 26/35 2024-09-16T07:30:52.815 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 27/35 2024-09-16T07:30:52.883 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 27/35 2024-09-16T07:30:52.960 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 28/35 2024-09-16T07:30:52.997 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-ceph-common-2:19.3.0-4879.g81fedcb3.el9.x8 29/35 2024-09-16T07:30:53.452 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 30/35 2024-09-16T07:30:53.493 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 30/35 2024-09-16T07:30:54.185 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 30/35 2024-09-16T07:30:54.229 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 31/35 2024-09-16T07:30:54.303 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 31/35 2024-09-16T07:30:54.304 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-16T07:30:54.304 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-16T07:30:54.304 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:30:54.347 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 32/35 2024-09-16T07:30:55.390 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 30/35 2024-09-16T07:30:55.419 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 30/35 2024-09-16T07:30:56.130 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 30/35 2024-09-16T07:30:56.211 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 31/35 2024-09-16T07:30:56.323 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 31/35 2024-09-16T07:30:56.323 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-16T07:30:56.323 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-16T07:30:56.323 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:30:56.357 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 32/35 2024-09-16T07:31:04.715 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 32/35 2024-09-16T07:31:04.715 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /sys 2024-09-16T07:31:04.716 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /proc 2024-09-16T07:31:04.716 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /mnt 2024-09-16T07:31:04.716 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /var/tmp 2024-09-16T07:31:04.716 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /home 2024-09-16T07:31:04.716 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /root 2024-09-16T07:31:04.716 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /tmp 2024-09-16T07:31:04.716 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:31:05.830 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/35 2024-09-16T07:31:05.855 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/35 2024-09-16T07:31:05.855 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T07:31:05.855 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-16T07:31:05.855 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T07:31:05.855 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T07:31:05.855 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:31:05.857 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-16T07:31:05.940 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-16T07:31:05.940 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-16T07:31:06.804 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 32/35 2024-09-16T07:31:06.805 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /sys 2024-09-16T07:31:06.805 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /proc 2024-09-16T07:31:06.805 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /mnt 2024-09-16T07:31:06.805 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /var/tmp 2024-09-16T07:31:06.805 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /home 2024-09-16T07:31:06.805 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /root 2024-09-16T07:31:06.805 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /tmp 2024-09-16T07:31:06.805 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:31:07.255 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-16T07:31:07.255 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/35 2024-09-16T07:31:07.255 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/35 2024-09-16T07:31:07.255 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 3/35 2024-09-16T07:31:07.255 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/35 2024-09-16T07:31:07.255 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 5/35 2024-09-16T07:31:07.255 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_6 6/35 2024-09-16T07:31:07.255 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 7/35 2024-09-16T07:31:07.255 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4879.g81fedcb3.el9. 8/35 2024-09-16T07:31:07.256 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-ceph-common-2:19.3.0-4879.g81fedcb3.el9.x8 9/35 2024-09-16T07:31:07.256 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 10/35 2024-09-16T07:31:07.256 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 11/35 2024-09-16T07:31:07.256 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 12/35 2024-09-16T07:31:07.256 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 13/35 2024-09-16T07:31:07.256 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/35 2024-09-16T07:31:07.256 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 15/35 2024-09-16T07:31:07.256 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 16/35 2024-09-16T07:31:07.256 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 17/35 2024-09-16T07:31:07.256 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 18/35 2024-09-16T07:31:07.256 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 19/35 2024-09-16T07:31:07.256 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-16T07:31:07.257 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 21/35 2024-09-16T07:31:07.257 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 22/35 2024-09-16T07:31:07.257 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 23/35 2024-09-16T07:31:07.257 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 24/35 2024-09-16T07:31:07.257 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 25/35 2024-09-16T07:31:07.257 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 26/35 2024-09-16T07:31:07.257 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 27/35 2024-09-16T07:31:07.257 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 28/35 2024-09-16T07:31:07.257 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 29/35 2024-09-16T07:31:07.257 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : re2-1:20211101-20.el9.x86_64 30/35 2024-09-16T07:31:07.258 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 31/35 2024-09-16T07:31:07.258 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 32/35 2024-09-16T07:31:07.258 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 33/35 2024-09-16T07:31:07.258 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 34/35 2024-09-16T07:31:07.910 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/35 2024-09-16T07:31:07.936 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/35 2024-09-16T07:31:07.936 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T07:31:07.936 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-16T07:31:07.936 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T07:31:07.936 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T07:31:07.936 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:31:07.938 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-16T07:31:08.021 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-16T07:31:08.021 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-16T07:31:08.139 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 35/35 2024-09-16T07:31:08.139 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:31:08.139 INFO:teuthology.orchestra.run.smithi172.stdout:Upgraded: 2024-09-16T07:31:08.139 INFO:teuthology.orchestra.run.smithi172.stdout: librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:31:08.139 INFO:teuthology.orchestra.run.smithi172.stdout: librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:31:08.139 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-09-16T07:31:08.139 INFO:teuthology.orchestra.run.smithi172.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-16T07:31:08.139 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:31:08.139 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:31:08.140 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:31:08.140 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:31:08.140 INFO:teuthology.orchestra.run.smithi172.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-16T07:31:08.140 INFO:teuthology.orchestra.run.smithi172.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-16T07:31:08.140 INFO:teuthology.orchestra.run.smithi172.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-16T07:31:08.140 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:31:08.140 INFO:teuthology.orchestra.run.smithi172.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-16T07:31:08.140 INFO:teuthology.orchestra.run.smithi172.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-16T07:31:08.140 INFO:teuthology.orchestra.run.smithi172.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-16T07:31:08.140 INFO:teuthology.orchestra.run.smithi172.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-16T07:31:08.140 INFO:teuthology.orchestra.run.smithi172.stdout: libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:31:08.141 INFO:teuthology.orchestra.run.smithi172.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-16T07:31:08.141 INFO:teuthology.orchestra.run.smithi172.stdout: librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:31:08.141 INFO:teuthology.orchestra.run.smithi172.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-16T07:31:08.141 INFO:teuthology.orchestra.run.smithi172.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-16T07:31:08.141 INFO:teuthology.orchestra.run.smithi172.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-16T07:31:08.141 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-argparse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:31:08.141 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:31:08.141 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:31:08.141 INFO:teuthology.orchestra.run.smithi172.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-16T07:31:08.141 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:31:08.141 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:31:08.141 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:31:08.141 INFO:teuthology.orchestra.run.smithi172.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-16T07:31:08.142 INFO:teuthology.orchestra.run.smithi172.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-16T07:31:08.142 INFO:teuthology.orchestra.run.smithi172.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-16T07:31:08.142 INFO:teuthology.orchestra.run.smithi172.stdout: re2-1:20211101-20.el9.x86_64 2024-09-16T07:31:08.142 INFO:teuthology.orchestra.run.smithi172.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-16T07:31:08.142 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:31:08.142 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-16T07:31:08.496 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-test 2024-09-16T07:31:09.072 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:00:29 ago on Mon 16 Sep 2024 07:30:40 AM UTC. 2024-09-16T07:31:09.212 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-16T07:31:09.213 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T07:31:09.213 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repository Size 2024-09-16T07:31:09.213 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T07:31:09.213 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-09-16T07:31:09.213 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-test x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 85 M 2024-09-16T07:31:09.213 INFO:teuthology.orchestra.run.smithi172.stdout:Installing dependencies: 2024-09-16T07:31:09.213 INFO:teuthology.orchestra.run.smithi172.stdout: libasan8 x86_64 14.2.1-1.2.el9 appstream 513 k 2024-09-16T07:31:09.213 INFO:teuthology.orchestra.run.smithi172.stdout: libcephsqlite x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 175 k 2024-09-16T07:31:09.213 INFO:teuthology.orchestra.run.smithi172.stdout: libubsan x86_64 11.5.0-2.el9 appstream 183 k 2024-09-16T07:31:09.214 INFO:teuthology.orchestra.run.smithi172.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-16T07:31:09.214 INFO:teuthology.orchestra.run.smithi172.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-16T07:31:09.214 INFO:teuthology.orchestra.run.smithi172.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-16T07:31:09.214 INFO:teuthology.orchestra.run.smithi172.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-16T07:31:09.214 INFO:teuthology.orchestra.run.smithi172.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2024-09-16T07:31:09.214 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:31:09.214 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-09-16T07:31:09.214 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T07:31:09.214 INFO:teuthology.orchestra.run.smithi172.stdout:Install 9 Packages 2024-09-16T07:31:09.214 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:31:09.215 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 87 M 2024-09-16T07:31:09.215 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 797 M 2024-09-16T07:31:09.215 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-09-16T07:31:09.309 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-16T07:31:09.310 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/35 2024-09-16T07:31:09.310 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/35 2024-09-16T07:31:09.310 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 3/35 2024-09-16T07:31:09.310 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/35 2024-09-16T07:31:09.310 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 5/35 2024-09-16T07:31:09.310 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_6 6/35 2024-09-16T07:31:09.310 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 7/35 2024-09-16T07:31:09.310 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4879.g81fedcb3.el9. 8/35 2024-09-16T07:31:09.310 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-ceph-common-2:19.3.0-4879.g81fedcb3.el9.x8 9/35 2024-09-16T07:31:09.310 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 10/35 2024-09-16T07:31:09.310 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 11/35 2024-09-16T07:31:09.311 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 12/35 2024-09-16T07:31:09.311 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 13/35 2024-09-16T07:31:09.311 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/35 2024-09-16T07:31:09.311 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 15/35 2024-09-16T07:31:09.311 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 16/35 2024-09-16T07:31:09.311 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 17/35 2024-09-16T07:31:09.311 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 18/35 2024-09-16T07:31:09.311 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 19/35 2024-09-16T07:31:09.311 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-16T07:31:09.312 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 21/35 2024-09-16T07:31:09.312 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 22/35 2024-09-16T07:31:09.312 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 23/35 2024-09-16T07:31:09.312 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 24/35 2024-09-16T07:31:09.312 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 25/35 2024-09-16T07:31:09.312 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 26/35 2024-09-16T07:31:09.312 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 27/35 2024-09-16T07:31:09.312 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 28/35 2024-09-16T07:31:09.312 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 29/35 2024-09-16T07:31:09.313 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : re2-1:20211101-20.el9.x86_64 30/35 2024-09-16T07:31:09.313 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 31/35 2024-09-16T07:31:09.313 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 32/35 2024-09-16T07:31:09.313 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 33/35 2024-09-16T07:31:09.313 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 34/35 2024-09-16T07:31:10.087 INFO:teuthology.orchestra.run.smithi172.stdout:(1/9): lksctp-tools-1.0.19-2.el9.x86_64.rpm 509 kB/s | 94 kB 00:00 2024-09-16T07:31:10.128 INFO:teuthology.orchestra.run.smithi172.stdout:(2/9): libcephsqlite-19.3.0-4879.g81fedcb3.el9. 772 kB/s | 175 kB 00:00 2024-09-16T07:31:10.144 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 35/35 2024-09-16T07:31:10.145 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:31:10.145 INFO:teuthology.orchestra.run.smithi121.stdout:Upgraded: 2024-09-16T07:31:10.145 INFO:teuthology.orchestra.run.smithi121.stdout: librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:31:10.145 INFO:teuthology.orchestra.run.smithi121.stdout: librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:31:10.145 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2024-09-16T07:31:10.145 INFO:teuthology.orchestra.run.smithi121.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-16T07:31:10.145 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:31:10.145 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:31:10.145 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:31:10.145 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:31:10.145 INFO:teuthology.orchestra.run.smithi121.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-16T07:31:10.145 INFO:teuthology.orchestra.run.smithi121.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-16T07:31:10.145 INFO:teuthology.orchestra.run.smithi121.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-16T07:31:10.146 INFO:teuthology.orchestra.run.smithi121.stdout: libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:31:10.146 INFO:teuthology.orchestra.run.smithi121.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-16T07:31:10.146 INFO:teuthology.orchestra.run.smithi121.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-16T07:31:10.146 INFO:teuthology.orchestra.run.smithi121.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-16T07:31:10.146 INFO:teuthology.orchestra.run.smithi121.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-16T07:31:10.146 INFO:teuthology.orchestra.run.smithi121.stdout: libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:31:10.146 INFO:teuthology.orchestra.run.smithi121.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-16T07:31:10.146 INFO:teuthology.orchestra.run.smithi121.stdout: librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:31:10.146 INFO:teuthology.orchestra.run.smithi121.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-16T07:31:10.146 INFO:teuthology.orchestra.run.smithi121.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-16T07:31:10.146 INFO:teuthology.orchestra.run.smithi121.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-16T07:31:10.146 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ceph-argparse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:31:10.146 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:31:10.146 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:31:10.147 INFO:teuthology.orchestra.run.smithi121.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-16T07:31:10.147 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:31:10.147 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:31:10.147 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:31:10.147 INFO:teuthology.orchestra.run.smithi121.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-16T07:31:10.147 INFO:teuthology.orchestra.run.smithi121.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-16T07:31:10.147 INFO:teuthology.orchestra.run.smithi121.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-16T07:31:10.147 INFO:teuthology.orchestra.run.smithi121.stdout: re2-1:20211101-20.el9.x86_64 2024-09-16T07:31:10.147 INFO:teuthology.orchestra.run.smithi121.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-16T07:31:10.147 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:31:10.147 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2024-09-16T07:31:10.287 INFO:teuthology.orchestra.run.smithi172.stdout:(3/9): libubsan-11.5.0-2.el9.x86_64.rpm 1.1 MB/s | 183 kB 00:00 2024-09-16T07:31:10.312 INFO:teuthology.orchestra.run.smithi172.stdout:(4/9): libasan8-14.2.1-1.2.el9.x86_64.rpm 2.2 MB/s | 513 kB 00:00 2024-09-16T07:31:10.371 INFO:teuthology.orchestra.run.smithi172.stdout:(5/9): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-16T07:31:10.405 INFO:teuthology.orchestra.run.smithi172.stdout:(6/9): protobuf-3.14.0-13.el9.x86_64.rpm 8.6 MB/s | 1.0 MB 00:00 2024-09-16T07:31:10.438 INFO:teuthology.orchestra.run.smithi172.stdout:(7/9): xmlstarlet-1.6.1-20.el9.x86_64.rpm 953 kB/s | 64 kB 00:00 2024-09-16T07:31:10.480 INFO:teuthology.orchestra.run.smithi172.stdout:(8/9): yaml-cpp-0.6.3-5.el9.x86_64.rpm 1.6 MB/s | 122 kB 00:00 2024-09-16T07:31:10.490 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install ceph-test 2024-09-16T07:31:11.052 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:00:29 ago on Mon 16 Sep 2024 07:30:42 AM UTC. 2024-09-16T07:31:11.185 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2024-09-16T07:31:11.186 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-09-16T07:31:11.186 INFO:teuthology.orchestra.run.smithi121.stdout: Package Arch Version Repository Size 2024-09-16T07:31:11.186 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-09-16T07:31:11.186 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2024-09-16T07:31:11.186 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-test x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 85 M 2024-09-16T07:31:11.186 INFO:teuthology.orchestra.run.smithi121.stdout:Installing dependencies: 2024-09-16T07:31:11.186 INFO:teuthology.orchestra.run.smithi121.stdout: libasan8 x86_64 14.2.1-1.2.el9 appstream 513 k 2024-09-16T07:31:11.186 INFO:teuthology.orchestra.run.smithi121.stdout: libcephsqlite x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 175 k 2024-09-16T07:31:11.186 INFO:teuthology.orchestra.run.smithi121.stdout: libubsan x86_64 11.5.0-2.el9 appstream 183 k 2024-09-16T07:31:11.187 INFO:teuthology.orchestra.run.smithi121.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-16T07:31:11.187 INFO:teuthology.orchestra.run.smithi121.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-16T07:31:11.187 INFO:teuthology.orchestra.run.smithi121.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-16T07:31:11.187 INFO:teuthology.orchestra.run.smithi121.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-16T07:31:11.187 INFO:teuthology.orchestra.run.smithi121.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2024-09-16T07:31:11.187 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:31:11.187 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2024-09-16T07:31:11.187 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-09-16T07:31:11.187 INFO:teuthology.orchestra.run.smithi121.stdout:Install 9 Packages 2024-09-16T07:31:11.187 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:31:11.188 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 87 M 2024-09-16T07:31:11.188 INFO:teuthology.orchestra.run.smithi121.stdout:Installed size: 797 M 2024-09-16T07:31:11.188 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading Packages: 2024-09-16T07:31:11.743 INFO:teuthology.orchestra.run.smithi121.stdout:(1/9): lksctp-tools-1.0.19-2.el9.x86_64.rpm 908 kB/s | 94 kB 00:00 2024-09-16T07:31:11.879 INFO:teuthology.orchestra.run.smithi121.stdout:(2/9): libcephsqlite-19.3.0-4879.g81fedcb3.el9. 737 kB/s | 175 kB 00:00 2024-09-16T07:31:11.902 INFO:teuthology.orchestra.run.smithi121.stdout:(3/9): libasan8-14.2.1-1.2.el9.x86_64.rpm 3.2 MB/s | 513 kB 00:00 2024-09-16T07:31:12.019 INFO:teuthology.orchestra.run.smithi121.stdout:(4/9): protobuf-3.14.0-13.el9.x86_64.rpm 8.6 MB/s | 1.0 MB 00:00 2024-09-16T07:31:12.066 INFO:teuthology.orchestra.run.smithi121.stdout:(5/9): libubsan-11.5.0-2.el9.x86_64.rpm 969 kB/s | 183 kB 00:00 2024-09-16T07:31:12.094 INFO:teuthology.orchestra.run.smithi121.stdout:(6/9): socat-1.7.4.1-6.el9.x86_64.rpm 4.0 MB/s | 304 kB 00:00 2024-09-16T07:31:12.128 INFO:teuthology.orchestra.run.smithi121.stdout:(7/9): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.0 MB/s | 64 kB 00:00 2024-09-16T07:31:12.153 INFO:teuthology.orchestra.run.smithi121.stdout:(8/9): yaml-cpp-0.6.3-5.el9.x86_64.rpm 2.0 MB/s | 122 kB 00:00 2024-09-16T07:31:12.389 INFO:teuthology.orchestra.run.smithi172.stdout:(9/9): ceph-test-19.3.0-4879.g81fedcb3.el9.x86_ 34 MB/s | 85 MB 00:02 2024-09-16T07:31:12.392 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:31:12.393 INFO:teuthology.orchestra.run.smithi172.stdout:Total 27 MB/s | 87 MB 00:03 2024-09-16T07:31:12.478 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-09-16T07:31:12.500 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-09-16T07:31:12.500 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-09-16T07:31:13.120 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-09-16T07:31:13.120 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-09-16T07:31:14.002 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-09-16T07:31:14.076 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/9 2024-09-16T07:31:14.125 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 2/9 2024-09-16T07:31:14.136 INFO:teuthology.orchestra.run.smithi121.stdout:(9/9): ceph-test-19.3.0-4879.g81fedcb3.el9.x86_ 34 MB/s | 85 MB 00:02 2024-09-16T07:31:14.140 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:31:14.140 INFO:teuthology.orchestra.run.smithi121.stdout:Total 29 MB/s | 87 MB 00:02 2024-09-16T07:31:14.176 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 3/9 2024-09-16T07:31:14.211 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 4/9 2024-09-16T07:31:14.223 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2024-09-16T07:31:14.243 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-16T07:31:14.246 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction check succeeded. 2024-09-16T07:31:14.246 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2024-09-16T07:31:14.268 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-16T07:31:14.340 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-16T07:31:14.384 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 7/9 2024-09-16T07:31:14.411 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 8/9 2024-09-16T07:31:14.871 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded. 2024-09-16T07:31:14.871 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2024-09-16T07:31:15.761 INFO:teuthology.orchestra.run.smithi121.stdout: Preparing : 1/1 2024-09-16T07:31:15.844 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/9 2024-09-16T07:31:15.889 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 2/9 2024-09-16T07:31:15.932 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 3/9 2024-09-16T07:31:15.959 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 4/9 2024-09-16T07:31:15.990 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-16T07:31:16.014 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-16T07:31:16.087 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-16T07:31:16.132 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 7/9 2024-09-16T07:31:16.158 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 8/9 2024-09-16T07:31:25.609 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 8/9 2024-09-16T07:31:25.685 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 9/9 2024-09-16T07:31:27.362 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 8/9 2024-09-16T07:31:27.438 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 9/9 2024-09-16T07:31:31.860 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 9/9 2024-09-16T07:31:31.860 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/9 2024-09-16T07:31:31.861 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/9 2024-09-16T07:31:31.861 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 3/9 2024-09-16T07:31:31.861 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libasan8-14.2.1-1.2.el9.x86_64 4/9 2024-09-16T07:31:31.861 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-16T07:31:31.861 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 6/9 2024-09-16T07:31:31.861 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 7/9 2024-09-16T07:31:31.861 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 8/9 2024-09-16T07:31:32.265 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 9/9 2024-09-16T07:31:32.265 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:31:32.265 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-09-16T07:31:32.265 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:31:32.265 INFO:teuthology.orchestra.run.smithi172.stdout: libasan8-14.2.1-1.2.el9.x86_64 2024-09-16T07:31:32.265 INFO:teuthology.orchestra.run.smithi172.stdout: libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:31:32.265 INFO:teuthology.orchestra.run.smithi172.stdout: libubsan-11.5.0-2.el9.x86_64 2024-09-16T07:31:32.265 INFO:teuthology.orchestra.run.smithi172.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-16T07:31:32.265 INFO:teuthology.orchestra.run.smithi172.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-16T07:31:32.266 INFO:teuthology.orchestra.run.smithi172.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-16T07:31:32.266 INFO:teuthology.orchestra.run.smithi172.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-16T07:31:32.266 INFO:teuthology.orchestra.run.smithi172.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2024-09-16T07:31:32.266 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:31:32.266 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-16T07:31:32.620 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph 2024-09-16T07:31:33.189 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:00:53 ago on Mon 16 Sep 2024 07:30:40 AM UTC. 2024-09-16T07:31:33.336 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-16T07:31:33.339 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T07:31:33.339 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repository Size 2024-09-16T07:31:33.339 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T07:31:33.339 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-09-16T07:31:33.339 INFO:teuthology.orchestra.run.smithi172.stdout: ceph x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 6.5 k 2024-09-16T07:31:33.339 INFO:teuthology.orchestra.run.smithi172.stdout:Installing dependencies: 2024-09-16T07:31:33.339 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mds x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 2.2 M 2024-09-16T07:31:33.339 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 1.6 M 2024-09-16T07:31:33.339 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 291 k 2024-09-16T07:31:33.339 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mon x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 5.1 M 2024-09-16T07:31:33.339 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-osd x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 70 M 2024-09-16T07:31:33.339 INFO:teuthology.orchestra.run.smithi172.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-16T07:31:33.340 INFO:teuthology.orchestra.run.smithi172.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-16T07:31:33.340 INFO:teuthology.orchestra.run.smithi172.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-16T07:31:33.340 INFO:teuthology.orchestra.run.smithi172.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-16T07:31:33.340 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-16T07:31:33.340 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-16T07:31:33.340 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-16T07:31:33.340 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-16T07:31:33.340 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-16T07:31:33.340 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-16T07:31:33.340 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-collections 2024-09-16T07:31:33.340 INFO:teuthology.orchestra.run.smithi172.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-16T07:31:33.340 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-16T07:31:33.341 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-16T07:31:33.341 INFO:teuthology.orchestra.run.smithi172.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-16T07:31:33.341 INFO:teuthology.orchestra.run.smithi172.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-16T07:31:33.341 INFO:teuthology.orchestra.run.smithi172.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-16T07:31:33.341 INFO:teuthology.orchestra.run.smithi172.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-16T07:31:33.341 INFO:teuthology.orchestra.run.smithi172.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-16T07:31:33.341 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-16T07:31:33.341 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-16T07:31:33.341 INFO:teuthology.orchestra.run.smithi172.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-16T07:31:33.341 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-16T07:31:33.341 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-16T07:31:33.341 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-16T07:31:33.341 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-16T07:31:33.342 INFO:teuthology.orchestra.run.smithi172.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-16T07:31:33.342 INFO:teuthology.orchestra.run.smithi172.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-16T07:31:33.342 INFO:teuthology.orchestra.run.smithi172.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-16T07:31:33.342 INFO:teuthology.orchestra.run.smithi172.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-16T07:31:33.342 INFO:teuthology.orchestra.run.smithi172.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-16T07:31:33.342 INFO:teuthology.orchestra.run.smithi172.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-16T07:31:33.342 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:31:33.342 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-09-16T07:31:33.342 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T07:31:33.342 INFO:teuthology.orchestra.run.smithi172.stdout:Install 37 Packages 2024-09-16T07:31:33.342 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:31:33.343 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 84 M 2024-09-16T07:31:33.343 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 897 M 2024-09-16T07:31:33.343 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-09-16T07:31:33.445 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 9/9 2024-09-16T07:31:33.445 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/9 2024-09-16T07:31:33.446 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/9 2024-09-16T07:31:33.446 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 3/9 2024-09-16T07:31:33.446 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libasan8-14.2.1-1.2.el9.x86_64 4/9 2024-09-16T07:31:33.446 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-16T07:31:33.446 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 6/9 2024-09-16T07:31:33.446 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 7/9 2024-09-16T07:31:33.446 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 8/9 2024-09-16T07:31:33.848 INFO:teuthology.orchestra.run.smithi172.stdout:(1/37): ceph-19.3.0-4879.g81fedcb3.el9.x86_64.r 52 kB/s | 6.5 kB 00:00 2024-09-16T07:31:33.866 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 9/9 2024-09-16T07:31:33.866 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:31:33.866 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2024-09-16T07:31:33.866 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:31:33.867 INFO:teuthology.orchestra.run.smithi121.stdout: libasan8-14.2.1-1.2.el9.x86_64 2024-09-16T07:31:33.867 INFO:teuthology.orchestra.run.smithi121.stdout: libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:31:33.867 INFO:teuthology.orchestra.run.smithi121.stdout: libubsan-11.5.0-2.el9.x86_64 2024-09-16T07:31:33.867 INFO:teuthology.orchestra.run.smithi121.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-16T07:31:33.867 INFO:teuthology.orchestra.run.smithi121.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-16T07:31:33.868 INFO:teuthology.orchestra.run.smithi121.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-16T07:31:33.868 INFO:teuthology.orchestra.run.smithi121.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-16T07:31:33.868 INFO:teuthology.orchestra.run.smithi121.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2024-09-16T07:31:33.869 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:31:33.869 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2024-09-16T07:31:34.039 INFO:teuthology.orchestra.run.smithi172.stdout:(2/37): ceph-mgr-19.3.0-4879.g81fedcb3.el9.x86_ 5.0 MB/s | 1.6 MB 00:00 2024-09-16T07:31:34.081 INFO:teuthology.orchestra.run.smithi172.stdout:(3/37): ceph-mds-19.3.0-4879.g81fedcb3.el9.x86_ 6.1 MB/s | 2.2 MB 00:00 2024-09-16T07:31:34.207 INFO:teuthology.orchestra.run.smithi172.stdout:(4/37): ceph-mgr-modules-core-19.3.0-4879.g81fe 2.3 MB/s | 291 kB 00:00 2024-09-16T07:31:34.216 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install ceph 2024-09-16T07:31:34.407 INFO:teuthology.orchestra.run.smithi172.stdout:(5/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.2 MB/s | 253 kB 00:00 2024-09-16T07:31:34.491 INFO:teuthology.orchestra.run.smithi172.stdout:(6/37): ceph-mon-19.3.0-4879.g81fedcb3.el9.x86_ 7.9 MB/s | 5.1 MB 00:00 2024-09-16T07:31:34.633 INFO:teuthology.orchestra.run.smithi172.stdout:(7/37): python3-cryptography-36.0.1-4.el9.x86_6 5.4 MB/s | 1.2 MB 00:00 2024-09-16T07:31:34.658 INFO:teuthology.orchestra.run.smithi172.stdout:(8/37): python3-ply-3.11-14.el9.noarch.rpm 638 kB/s | 106 kB 00:00 2024-09-16T07:31:34.683 INFO:teuthology.orchestra.run.smithi172.stdout:(9/37): python3-pycparser-2.20-6.el9.noarch.rpm 2.6 MB/s | 135 kB 00:00 2024-09-16T07:31:34.742 INFO:teuthology.orchestra.run.smithi172.stdout:(10/37): python3-requests-2.25.1-8.el9.noarch.r 1.5 MB/s | 125 kB 00:00 2024-09-16T07:31:34.767 INFO:teuthology.orchestra.run.smithi172.stdout:(11/37): python3-urllib3-1.26.5-6.el9.noarch.rp 2.5 MB/s | 215 kB 00:00 2024-09-16T07:31:34.777 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:00:52 ago on Mon 16 Sep 2024 07:30:42 AM UTC. 2024-09-16T07:31:34.921 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2024-09-16T07:31:34.924 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-09-16T07:31:34.924 INFO:teuthology.orchestra.run.smithi121.stdout: Package Arch Version Repository Size 2024-09-16T07:31:34.924 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-09-16T07:31:34.924 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2024-09-16T07:31:34.924 INFO:teuthology.orchestra.run.smithi121.stdout: ceph x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 6.5 k 2024-09-16T07:31:34.924 INFO:teuthology.orchestra.run.smithi121.stdout:Installing dependencies: 2024-09-16T07:31:34.924 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mds x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 2.2 M 2024-09-16T07:31:34.924 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 1.6 M 2024-09-16T07:31:34.924 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 291 k 2024-09-16T07:31:34.924 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mon x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 5.1 M 2024-09-16T07:31:34.924 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-osd x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 70 M 2024-09-16T07:31:34.925 INFO:teuthology.orchestra.run.smithi121.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-16T07:31:34.925 INFO:teuthology.orchestra.run.smithi121.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-16T07:31:34.925 INFO:teuthology.orchestra.run.smithi121.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-16T07:31:34.925 INFO:teuthology.orchestra.run.smithi121.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-16T07:31:34.925 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-16T07:31:34.925 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-16T07:31:34.925 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-16T07:31:34.925 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-16T07:31:34.925 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-16T07:31:34.925 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-16T07:31:34.925 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-collections 2024-09-16T07:31:34.925 INFO:teuthology.orchestra.run.smithi121.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-16T07:31:34.925 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-16T07:31:34.926 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-16T07:31:34.926 INFO:teuthology.orchestra.run.smithi121.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-16T07:31:34.926 INFO:teuthology.orchestra.run.smithi121.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-16T07:31:34.926 INFO:teuthology.orchestra.run.smithi121.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-16T07:31:34.926 INFO:teuthology.orchestra.run.smithi121.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-16T07:31:34.926 INFO:teuthology.orchestra.run.smithi121.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-16T07:31:34.926 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-16T07:31:34.926 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-16T07:31:34.926 INFO:teuthology.orchestra.run.smithi121.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-16T07:31:34.926 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-16T07:31:34.926 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-16T07:31:34.926 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-16T07:31:34.926 INFO:teuthology.orchestra.run.smithi121.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-16T07:31:34.927 INFO:teuthology.orchestra.run.smithi121.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-16T07:31:34.927 INFO:teuthology.orchestra.run.smithi121.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-16T07:31:34.927 INFO:teuthology.orchestra.run.smithi121.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-16T07:31:34.927 INFO:teuthology.orchestra.run.smithi121.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-16T07:31:34.927 INFO:teuthology.orchestra.run.smithi121.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-16T07:31:34.927 INFO:teuthology.orchestra.run.smithi121.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-16T07:31:34.927 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:31:34.927 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2024-09-16T07:31:34.927 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-09-16T07:31:34.927 INFO:teuthology.orchestra.run.smithi121.stdout:Install 37 Packages 2024-09-16T07:31:34.927 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:31:34.928 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 84 M 2024-09-16T07:31:34.928 INFO:teuthology.orchestra.run.smithi121.stdout:Installed size: 897 M 2024-09-16T07:31:34.928 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading Packages: 2024-09-16T07:31:35.501 INFO:teuthology.orchestra.run.smithi172.stdout:(12/37): lua-5.4.4-4.el9.x86_64.rpm 248 kB/s | 188 kB 00:00 2024-09-16T07:31:35.525 INFO:teuthology.orchestra.run.smithi172.stdout:(13/37): python3-mako-1.1.4-6.el9.noarch.rpm 227 kB/s | 172 kB 00:00 2024-09-16T07:31:36.098 INFO:teuthology.orchestra.run.smithi121.stdout:(1/37): ceph-19.3.0-4879.g81fedcb3.el9.x86_64.r 37 kB/s | 6.5 kB 00:00 2024-09-16T07:31:36.151 INFO:teuthology.orchestra.run.smithi172.stdout:(14/37): ceph-osd-19.3.0-4879.g81fedcb3.el9.x86 33 MB/s | 70 MB 00:02 2024-09-16T07:31:36.643 INFO:teuthology.orchestra.run.smithi172.stdout:(15/37): python3-markupsafe-1.1.1-12.el9.x86_64 30 kB/s | 35 kB 00:01 2024-09-16T07:31:36.743 INFO:teuthology.orchestra.run.smithi172.stdout:(16/37): python3-pytz-2021.1-5.el9.noarch.rpm 86 kB/s | 51 kB 00:00 2024-09-16T07:31:36.777 INFO:teuthology.orchestra.run.smithi172.stdout:(17/37): python3-packaging-20.9-5.el9.noarch.rp 62 kB/s | 77 kB 00:01 2024-09-16T07:31:36.835 INFO:teuthology.orchestra.run.smithi172.stdout:(18/37): luarocks-3.9.2-5.el9.noarch.rpm 2.6 MB/s | 151 kB 00:00 2024-09-16T07:31:36.861 INFO:teuthology.orchestra.run.smithi172.stdout:(19/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.7 MB/s | 43 kB 00:00 2024-09-16T07:31:36.894 INFO:teuthology.orchestra.run.smithi172.stdout:(20/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 6.5 MB/s | 172 kB 00:00 2024-09-16T07:31:36.928 INFO:teuthology.orchestra.run.smithi172.stdout:(21/37): python3-cherrypy-18.6.1-2.el9.noarch.r 10 MB/s | 358 kB 00:00 2024-09-16T07:31:36.961 INFO:teuthology.orchestra.run.smithi172.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 322 kB/s | 11 kB 00:00 2024-09-16T07:31:36.995 INFO:teuthology.orchestra.run.smithi172.stdout:(23/37): python3-jaraco-classes-3.2.1-5.el9.noa 541 kB/s | 18 kB 00:00 2024-09-16T07:31:37.029 INFO:teuthology.orchestra.run.smithi172.stdout:(24/37): python3-jaraco-collections-3.0.0-8.el9 693 kB/s | 23 kB 00:00 2024-09-16T07:31:37.054 INFO:teuthology.orchestra.run.smithi172.stdout:(25/37): python3-jaraco-functools-3.5.0-2.el9.n 785 kB/s | 19 kB 00:00 2024-09-16T07:31:37.080 INFO:teuthology.orchestra.run.smithi172.stdout:(26/37): python3-jaraco-text-3.2.0-6.el9.noarch 795 kB/s | 20 kB 00:00 2024-09-16T07:31:37.105 INFO:teuthology.orchestra.run.smithi172.stdout:(27/37): python3-logutils-0.3.5-21.el9.noarch.r 1.9 MB/s | 46 kB 00:00 2024-09-16T07:31:37.130 INFO:teuthology.orchestra.run.smithi172.stdout:(28/37): python3-more-itertools-8.12.0-2.el9.no 3.1 MB/s | 79 kB 00:00 2024-09-16T07:31:37.155 INFO:teuthology.orchestra.run.smithi172.stdout:(29/37): python3-pecan-1.4.2-3.el9.noarch.rpm 11 MB/s | 272 kB 00:00 2024-09-16T07:31:37.181 INFO:teuthology.orchestra.run.smithi172.stdout:(30/37): python3-portend-3.1.0-2.el9.noarch.rpm 660 kB/s | 16 kB 00:00 2024-09-16T07:31:37.206 INFO:teuthology.orchestra.run.smithi172.stdout:(31/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 3.5 MB/s | 90 kB 00:00 2024-09-16T07:31:37.231 INFO:teuthology.orchestra.run.smithi172.stdout:(32/37): python3-tempora-5.0.0-2.el9.noarch.rpm 1.4 MB/s | 36 kB 00:00 2024-09-16T07:31:37.248 INFO:teuthology.orchestra.run.smithi121.stdout:(2/37): ceph-mgr-19.3.0-4879.g81fedcb3.el9.x86_ 1.2 MB/s | 1.6 MB 00:01 2024-09-16T07:31:37.256 INFO:teuthology.orchestra.run.smithi172.stdout:(33/37): python3-toml-0.10.2-6.el9.noarch.rpm 68 kB/s | 42 kB 00:00 2024-09-16T07:31:37.290 INFO:teuthology.orchestra.run.smithi172.stdout:(34/37): python3-webob-1.8.8-2.el9.noarch.rpm 3.8 MB/s | 230 kB 00:00 2024-09-16T07:31:37.315 INFO:teuthology.orchestra.run.smithi172.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 855 kB/s | 20 kB 00:00 2024-09-16T07:31:37.341 INFO:teuthology.orchestra.run.smithi172.stdout:(36/37): lua-devel-5.4.4-4.el9.x86_64.rpm 37 kB/s | 22 kB 00:00 2024-09-16T07:31:37.391 INFO:teuthology.orchestra.run.smithi172.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.1 MB/s | 427 kB 00:00 2024-09-16T07:31:37.395 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:31:37.395 INFO:teuthology.orchestra.run.smithi172.stdout:Total 21 MB/s | 84 MB 00:04 2024-09-16T07:31:37.440 INFO:teuthology.orchestra.run.smithi121.stdout:(3/37): ceph-mds-19.3.0-4879.g81fedcb3.el9.x86_ 1.4 MB/s | 2.2 MB 00:01 2024-09-16T07:31:37.541 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-09-16T07:31:37.583 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-09-16T07:31:37.584 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-09-16T07:31:37.599 INFO:teuthology.orchestra.run.smithi121.stdout:(4/37): ceph-mgr-modules-core-19.3.0-4879.g81fe 1.8 MB/s | 291 kB 00:00 2024-09-16T07:31:37.765 INFO:teuthology.orchestra.run.smithi121.stdout:(5/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.5 MB/s | 253 kB 00:00 2024-09-16T07:31:37.874 INFO:teuthology.orchestra.run.smithi121.stdout:(6/37): python3-cryptography-36.0.1-4.el9.x86_6 11 MB/s | 1.2 MB 00:00 2024-09-16T07:31:37.925 INFO:teuthology.orchestra.run.smithi121.stdout:(7/37): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-16T07:31:37.975 INFO:teuthology.orchestra.run.smithi121.stdout:(8/37): python3-pycparser-2.20-6.el9.noarch.rpm 2.6 MB/s | 135 kB 00:00 2024-09-16T07:31:38.029 INFO:teuthology.orchestra.run.smithi121.stdout:(9/37): python3-requests-2.25.1-8.el9.noarch.rp 2.3 MB/s | 125 kB 00:00 2024-09-16T07:31:38.079 INFO:teuthology.orchestra.run.smithi121.stdout:(10/37): python3-urllib3-1.26.5-6.el9.noarch.rp 4.2 MB/s | 215 kB 00:00 2024-09-16T07:31:38.129 INFO:teuthology.orchestra.run.smithi121.stdout:(11/37): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-09-16T07:31:38.179 INFO:teuthology.orchestra.run.smithi121.stdout:(12/37): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-09-16T07:31:38.221 INFO:teuthology.orchestra.run.smithi121.stdout:(13/37): python3-markupsafe-1.1.1-12.el9.x86_64 836 kB/s | 35 kB 00:00 2024-09-16T07:31:38.272 INFO:teuthology.orchestra.run.smithi121.stdout:(14/37): python3-packaging-20.9-5.el9.noarch.rp 1.5 MB/s | 77 kB 00:00 2024-09-16T07:31:38.314 INFO:teuthology.orchestra.run.smithi121.stdout:(15/37): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-09-16T07:31:38.355 INFO:teuthology.orchestra.run.smithi121.stdout:(16/37): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2024-09-16T07:31:38.381 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-09-16T07:31:38.381 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-09-16T07:31:38.464 INFO:teuthology.orchestra.run.smithi121.stdout:(17/37): lua-devel-5.4.4-4.el9.x86_64.rpm 206 kB/s | 22 kB 00:00 2024-09-16T07:31:38.506 INFO:teuthology.orchestra.run.smithi121.stdout:(18/37): luarocks-3.9.2-5.el9.noarch.rpm 3.6 MB/s | 151 kB 00:00 2024-09-16T07:31:38.523 INFO:teuthology.orchestra.run.smithi121.stdout:(19/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 2.6 MB/s | 43 kB 00:00 2024-09-16T07:31:38.548 INFO:teuthology.orchestra.run.smithi121.stdout:(20/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 6.7 MB/s | 172 kB 00:00 2024-09-16T07:31:38.582 INFO:teuthology.orchestra.run.smithi121.stdout:(21/37): python3-cherrypy-18.6.1-2.el9.noarch.r 10 MB/s | 358 kB 00:00 2024-09-16T07:31:38.599 INFO:teuthology.orchestra.run.smithi121.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 644 kB/s | 11 kB 00:00 2024-09-16T07:31:38.624 INFO:teuthology.orchestra.run.smithi121.stdout:(23/37): python3-jaraco-classes-3.2.1-5.el9.noa 711 kB/s | 18 kB 00:00 2024-09-16T07:31:38.649 INFO:teuthology.orchestra.run.smithi121.stdout:(24/37): python3-jaraco-collections-3.0.0-8.el9 933 kB/s | 23 kB 00:00 2024-09-16T07:31:38.675 INFO:teuthology.orchestra.run.smithi121.stdout:(25/37): python3-jaraco-functools-3.5.0-2.el9.n 773 kB/s | 19 kB 00:00 2024-09-16T07:31:38.700 INFO:teuthology.orchestra.run.smithi121.stdout:(26/37): python3-jaraco-text-3.2.0-6.el9.noarch 790 kB/s | 20 kB 00:00 2024-09-16T07:31:38.725 INFO:teuthology.orchestra.run.smithi121.stdout:(27/37): python3-logutils-0.3.5-21.el9.noarch.r 1.8 MB/s | 46 kB 00:00 2024-09-16T07:31:38.750 INFO:teuthology.orchestra.run.smithi121.stdout:(28/37): python3-more-itertools-8.12.0-2.el9.no 3.1 MB/s | 79 kB 00:00 2024-09-16T07:31:38.776 INFO:teuthology.orchestra.run.smithi121.stdout:(29/37): python3-pecan-1.4.2-3.el9.noarch.rpm 11 MB/s | 272 kB 00:00 2024-09-16T07:31:38.801 INFO:teuthology.orchestra.run.smithi121.stdout:(30/37): python3-portend-3.1.0-2.el9.noarch.rpm 659 kB/s | 16 kB 00:00 2024-09-16T07:31:38.827 INFO:teuthology.orchestra.run.smithi121.stdout:(31/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 3.5 MB/s | 90 kB 00:00 2024-09-16T07:31:38.852 INFO:teuthology.orchestra.run.smithi121.stdout:(32/37): python3-tempora-5.0.0-2.el9.noarch.rpm 1.4 MB/s | 36 kB 00:00 2024-09-16T07:31:38.877 INFO:teuthology.orchestra.run.smithi121.stdout:(33/37): python3-webob-1.8.8-2.el9.noarch.rpm 9.0 MB/s | 230 kB 00:00 2024-09-16T07:31:38.910 INFO:teuthology.orchestra.run.smithi121.stdout:(34/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 13 MB/s | 427 kB 00:00 2024-09-16T07:31:38.936 INFO:teuthology.orchestra.run.smithi121.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 797 kB/s | 20 kB 00:00 2024-09-16T07:31:39.019 INFO:teuthology.orchestra.run.smithi121.stdout:(36/37): ceph-mon-19.3.0-4879.g81fedcb3.el9.x86 1.7 MB/s | 5.1 MB 00:02 2024-09-16T07:31:40.059 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-09-16T07:31:40.135 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-16T07:31:40.168 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-16T07:31:40.195 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-16T07:31:40.277 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-16T07:31:40.319 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-16T07:31:40.352 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-16T07:31:40.444 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-16T07:31:40.522 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-16T07:31:40.563 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-16T07:31:40.606 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-16T07:31:40.645 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-16T07:31:40.679 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-16T07:31:40.712 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-16T07:31:40.753 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-16T07:31:40.788 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-16T07:31:40.822 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-16T07:31:40.871 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-16T07:31:40.902 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-16T07:31:40.975 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-16T07:31:41.124 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-16T07:31:41.213 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-16T07:31:41.273 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-16T07:31:41.312 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-16T07:31:41.361 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-16T07:31:41.416 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-16T07:31:41.606 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-16T07:31:41.658 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-16T07:31:41.737 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-16T07:31:41.825 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-16T07:31:41.880 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-16T07:31:42.021 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-16T07:31:42.220 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4879.g81fedcb3.el9. 32/37 2024-09-16T07:31:42.251 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/37 2024-09-16T07:31:42.277 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/37 2024-09-16T07:31:42.277 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T07:31:42.277 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-16T07:31:42.277 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T07:31:42.277 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T07:31:42.277 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:31:48.510 INFO:teuthology.orchestra.run.smithi121.stdout:(37/37): ceph-osd-19.3.0-4879.g81fedcb3.el9.x86 6.3 MB/s | 70 MB 00:11 2024-09-16T07:31:48.514 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:31:48.514 INFO:teuthology.orchestra.run.smithi121.stdout:Total 6.2 MB/s | 84 MB 00:13 2024-09-16T07:31:48.664 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2024-09-16T07:31:48.704 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction check succeeded. 2024-09-16T07:31:48.704 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2024-09-16T07:31:49.536 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded. 2024-09-16T07:31:49.537 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2024-09-16T07:31:51.235 INFO:teuthology.orchestra.run.smithi121.stdout: Preparing : 1/1 2024-09-16T07:31:51.304 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-16T07:31:51.337 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-16T07:31:51.364 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-16T07:31:51.436 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-16T07:31:51.472 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-16T07:31:51.505 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-16T07:31:51.596 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-16T07:31:51.691 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-16T07:31:51.732 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-16T07:31:51.767 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-16T07:31:51.797 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-16T07:31:51.831 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-16T07:31:51.865 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-16T07:31:51.906 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-16T07:31:51.941 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-16T07:31:51.975 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-16T07:31:52.023 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-16T07:31:52.058 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-16T07:31:52.131 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-16T07:31:52.318 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-16T07:31:52.399 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-16T07:31:52.452 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-16T07:31:52.491 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-16T07:31:52.539 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-16T07:31:52.596 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-16T07:31:52.779 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-16T07:31:52.800 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 34/37 2024-09-16T07:31:52.827 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 34/37 2024-09-16T07:31:52.827 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T07:31:52.827 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-16T07:31:52.827 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T07:31:52.827 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T07:31:52.828 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:31:52.845 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-16T07:31:52.922 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-16T07:31:53.019 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-16T07:31:53.070 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-16T07:31:53.205 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-16T07:31:53.368 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 35/37 2024-09-16T07:31:53.391 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 35/37 2024-09-16T07:31:53.391 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T07:31:53.391 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-16T07:31:53.391 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T07:31:53.391 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T07:31:53.392 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:31:53.398 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4879.g81fedcb3.el9. 32/37 2024-09-16T07:31:53.421 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/37 2024-09-16T07:31:53.448 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/37 2024-09-16T07:31:53.448 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T07:31:53.449 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-16T07:31:53.449 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T07:31:53.449 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T07:31:53.449 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:31:53.626 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 36/37 2024-09-16T07:31:53.650 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 36/37 2024-09-16T07:31:53.650 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T07:31:53.650 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-16T07:31:53.650 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T07:31:53.650 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T07:31:53.650 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:31:53.715 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 37/37 2024-09-16T07:32:00.303 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 37/37 2024-09-16T07:32:00.303 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/37 2024-09-16T07:32:00.303 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/37 2024-09-16T07:32:00.303 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 3/37 2024-09-16T07:32:00.304 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/37 2024-09-16T07:32:00.304 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 5/37 2024-09-16T07:32:00.304 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4879.g81fedcb3.el9. 6/37 2024-09-16T07:32:00.304 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-16T07:32:00.304 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-16T07:32:00.304 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-16T07:32:00.304 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-16T07:32:00.304 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-16T07:32:00.304 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-16T07:32:00.304 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-16T07:32:00.304 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-16T07:32:00.304 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-16T07:32:00.304 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-16T07:32:00.304 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-16T07:32:00.305 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-16T07:32:00.305 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-16T07:32:00.305 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-16T07:32:00.305 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-16T07:32:00.305 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-16T07:32:00.305 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-16T07:32:00.305 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-16T07:32:00.305 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-16T07:32:00.306 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-16T07:32:00.306 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-16T07:32:00.306 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-16T07:32:00.306 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-16T07:32:00.307 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-16T07:32:00.307 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-16T07:32:00.307 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-16T07:32:00.307 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-16T07:32:00.307 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-16T07:32:00.307 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-16T07:32:00.307 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-16T07:32:01.239 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-16T07:32:01.239 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:32:01.239 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-09-16T07:32:01.239 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:32:01.239 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:32:01.239 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:32:01.239 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-modules-core-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T07:32:01.239 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:32:01.240 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:32:01.240 INFO:teuthology.orchestra.run.smithi172.stdout: lua-5.4.4-4.el9.x86_64 2024-09-16T07:32:01.240 INFO:teuthology.orchestra.run.smithi172.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-16T07:32:01.240 INFO:teuthology.orchestra.run.smithi172.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-16T07:32:01.240 INFO:teuthology.orchestra.run.smithi172.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-16T07:32:01.240 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-16T07:32:01.240 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-16T07:32:01.240 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-16T07:32:01.240 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-16T07:32:01.240 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-16T07:32:01.240 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-16T07:32:01.240 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-16T07:32:01.240 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-16T07:32:01.241 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-16T07:32:01.241 INFO:teuthology.orchestra.run.smithi172.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-16T07:32:01.241 INFO:teuthology.orchestra.run.smithi172.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-16T07:32:01.241 INFO:teuthology.orchestra.run.smithi172.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-16T07:32:01.241 INFO:teuthology.orchestra.run.smithi172.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-16T07:32:01.241 INFO:teuthology.orchestra.run.smithi172.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-16T07:32:01.241 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-16T07:32:01.241 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ply-3.11-14.el9.noarch 2024-09-16T07:32:01.241 INFO:teuthology.orchestra.run.smithi172.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-16T07:32:01.241 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-16T07:32:01.241 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-16T07:32:01.241 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-16T07:32:01.242 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-16T07:32:01.242 INFO:teuthology.orchestra.run.smithi172.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-16T07:32:01.242 INFO:teuthology.orchestra.run.smithi172.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-16T07:32:01.242 INFO:teuthology.orchestra.run.smithi172.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-16T07:32:01.242 INFO:teuthology.orchestra.run.smithi172.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-16T07:32:01.242 INFO:teuthology.orchestra.run.smithi172.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-16T07:32:01.242 INFO:teuthology.orchestra.run.smithi172.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-16T07:32:01.242 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:32:01.242 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-16T07:32:01.523 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-base 2024-09-16T07:32:02.126 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:01:22 ago on Mon 16 Sep 2024 07:30:40 AM UTC. 2024-09-16T07:32:02.222 INFO:teuthology.orchestra.run.smithi172.stdout:Package ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T07:32:02.266 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-16T07:32:02.267 INFO:teuthology.orchestra.run.smithi172.stdout:Nothing to do. 2024-09-16T07:32:02.267 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-16T07:32:02.346 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install cephadm 2024-09-16T07:32:02.924 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:01:22 ago on Mon 16 Sep 2024 07:30:40 AM UTC. 2024-09-16T07:32:03.057 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-16T07:32:03.058 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T07:32:03.058 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repository Size 2024-09-16T07:32:03.058 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T07:32:03.058 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-09-16T07:32:03.058 INFO:teuthology.orchestra.run.smithi172.stdout: cephadm noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 785 k 2024-09-16T07:32:03.058 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:32:03.058 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-09-16T07:32:03.058 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T07:32:03.058 INFO:teuthology.orchestra.run.smithi172.stdout:Install 1 Package 2024-09-16T07:32:03.058 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:32:03.058 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 785 k 2024-09-16T07:32:03.058 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 791 k 2024-09-16T07:32:03.059 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-09-16T07:32:03.334 INFO:teuthology.orchestra.run.smithi172.stdout:cephadm-19.3.0-4879.g81fedcb3.el9.noarch.rpm 2.8 MB/s | 785 kB 00:00 2024-09-16T07:32:03.335 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:32:03.335 INFO:teuthology.orchestra.run.smithi172.stdout:Total 2.8 MB/s | 785 kB 00:00 2024-09-16T07:32:03.335 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-09-16T07:32:03.340 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-09-16T07:32:03.341 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-09-16T07:32:03.347 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-09-16T07:32:03.347 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-09-16T07:32:03.421 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-09-16T07:32:03.845 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T07:32:03.945 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T07:32:04.029 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 34/37 2024-09-16T07:32:04.057 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 34/37 2024-09-16T07:32:04.057 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T07:32:04.057 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-16T07:32:04.057 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T07:32:04.057 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T07:32:04.057 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:32:04.368 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T07:32:04.605 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 35/37 2024-09-16T07:32:04.614 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T07:32:04.614 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:32:04.614 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-09-16T07:32:04.615 INFO:teuthology.orchestra.run.smithi172.stdout: cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T07:32:04.615 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:32:04.615 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-16T07:32:04.629 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 35/37 2024-09-16T07:32:04.629 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T07:32:04.629 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-16T07:32:04.629 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T07:32:04.629 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T07:32:04.629 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:32:04.837 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-immutable-object-cache 2024-09-16T07:32:04.864 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 36/37 2024-09-16T07:32:04.888 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 36/37 2024-09-16T07:32:04.888 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T07:32:04.888 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-16T07:32:04.888 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T07:32:04.888 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T07:32:04.888 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:32:04.961 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 37/37 2024-09-16T07:32:05.413 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:01:25 ago on Mon 16 Sep 2024 07:30:40 AM UTC. 2024-09-16T07:32:05.549 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-16T07:32:05.549 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T07:32:05.550 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repo Size 2024-09-16T07:32:05.550 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T07:32:05.550 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-09-16T07:32:05.550 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 158 k 2024-09-16T07:32:05.550 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:32:05.550 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-09-16T07:32:05.550 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T07:32:05.550 INFO:teuthology.orchestra.run.smithi172.stdout:Install 1 Package 2024-09-16T07:32:05.550 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:32:05.550 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 158 k 2024-09-16T07:32:05.550 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 644 k 2024-09-16T07:32:05.550 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-09-16T07:32:05.757 INFO:teuthology.orchestra.run.smithi172.stdout:ceph-immutable-object-cache-19.3.0-4879.g81fedc 767 kB/s | 158 kB 00:00 2024-09-16T07:32:05.757 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:32:05.757 INFO:teuthology.orchestra.run.smithi172.stdout:Total 762 kB/s | 158 kB 00:00 2024-09-16T07:32:05.757 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-09-16T07:32:05.767 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-09-16T07:32:05.767 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-09-16T07:32:05.824 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-09-16T07:32:05.824 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-09-16T07:32:05.969 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-09-16T07:32:06.041 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3. 1/1 2024-09-16T07:32:06.065 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3. 1/1 2024-09-16T07:32:06.065 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T07:32:06.065 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-16T07:32:06.065 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:32:07.059 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3. 1/1 2024-09-16T07:32:07.059 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:32:07.059 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-09-16T07:32:07.059 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:32:07.060 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:32:07.060 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-16T07:32:07.276 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-mgr 2024-09-16T07:32:07.859 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:01:27 ago on Mon 16 Sep 2024 07:30:40 AM UTC. 2024-09-16T07:32:07.951 INFO:teuthology.orchestra.run.smithi172.stdout:Package ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T07:32:07.993 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-16T07:32:07.994 INFO:teuthology.orchestra.run.smithi172.stdout:Nothing to do. 2024-09-16T07:32:07.994 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-16T07:32:08.068 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-mgr-dashboard 2024-09-16T07:32:08.632 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:01:28 ago on Mon 16 Sep 2024 07:30:40 AM UTC. 2024-09-16T07:32:08.767 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-16T07:32:08.768 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T07:32:08.768 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repository Size 2024-09-16T07:32:08.768 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T07:32:08.768 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-09-16T07:32:08.768 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 14 M 2024-09-16T07:32:08.768 INFO:teuthology.orchestra.run.smithi172.stdout:Installing dependencies: 2024-09-16T07:32:08.768 INFO:teuthology.orchestra.run.smithi172.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-16T07:32:08.768 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 34 k 2024-09-16T07:32:08.768 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 16 k 2024-09-16T07:32:08.768 INFO:teuthology.orchestra.run.smithi172.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-16T07:32:08.769 INFO:teuthology.orchestra.run.smithi172.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-16T07:32:08.769 INFO:teuthology.orchestra.run.smithi172.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-16T07:32:08.769 INFO:teuthology.orchestra.run.smithi172.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-16T07:32:08.769 INFO:teuthology.orchestra.run.smithi172.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-16T07:32:08.769 INFO:teuthology.orchestra.run.smithi172.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-16T07:32:08.769 INFO:teuthology.orchestra.run.smithi172.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-16T07:32:08.769 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:32:08.769 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-09-16T07:32:08.769 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T07:32:08.769 INFO:teuthology.orchestra.run.smithi172.stdout:Install 11 Packages 2024-09-16T07:32:08.769 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:32:08.770 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 18 M 2024-09-16T07:32:08.770 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 155 M 2024-09-16T07:32:08.770 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-09-16T07:32:09.152 INFO:teuthology.orchestra.run.smithi172.stdout:(1/11): ceph-grafana-dashboards-19.3.0-4879.g81 223 kB/s | 34 kB 00:00 2024-09-16T07:32:09.177 INFO:teuthology.orchestra.run.smithi172.stdout:(2/11): ceph-prometheus-alerts-19.3.0-4879.g81f 92 kB/s | 16 kB 00:00 2024-09-16T07:32:09.344 INFO:teuthology.orchestra.run.smithi172.stdout:(3/11): python3-protobuf-3.14.0-13.el9.noarch.r 1.4 MB/s | 269 kB 00:00 2024-09-16T07:32:09.402 INFO:teuthology.orchestra.run.smithi172.stdout:(4/11): abseil-cpp-20211102.0-3.el9.x86_64.rpm 9.2 MB/s | 548 kB 00:00 2024-09-16T07:32:09.428 INFO:teuthology.orchestra.run.smithi172.stdout:(5/11): grpc-data-1.46.7-10.el9.noarch.rpm 779 kB/s | 19 kB 00:00 2024-09-16T07:32:09.495 INFO:teuthology.orchestra.run.smithi172.stdout:(6/11): python3-grpcio-1.46.7-10.el9.x86_64.rpm 31 MB/s | 2.0 MB 00:00 2024-09-16T07:32:09.520 INFO:teuthology.orchestra.run.smithi172.stdout:(7/11): python3-grpcio-tools-1.46.7-10.el9.x86_ 5.7 MB/s | 144 kB 00:00 2024-09-16T07:32:09.545 INFO:teuthology.orchestra.run.smithi172.stdout:(8/11): python3-repoze-lru-0.7-16.el9.noarch.rp 1.2 MB/s | 31 kB 00:00 2024-09-16T07:32:09.579 INFO:teuthology.orchestra.run.smithi172.stdout:(9/11): protobuf-compiler-3.14.0-13.el9.x86_64. 2.1 MB/s | 863 kB 00:00 2024-09-16T07:32:09.604 INFO:teuthology.orchestra.run.smithi172.stdout:(10/11): python3-routes-2.5.1-5.el9.noarch.rpm 3.1 MB/s | 188 kB 00:00 2024-09-16T07:32:09.821 INFO:teuthology.orchestra.run.smithi172.stdout:(11/11): ceph-mgr-dashboard-19.3.0-4879.g81fedc 17 MB/s | 14 MB 00:00 2024-09-16T07:32:09.824 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:32:09.824 INFO:teuthology.orchestra.run.smithi172.stdout:Total 17 MB/s | 18 MB 00:01 2024-09-16T07:32:09.854 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-09-16T07:32:09.873 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-09-16T07:32:09.873 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-09-16T07:32:10.132 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-09-16T07:32:10.132 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-09-16T07:32:10.683 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-09-16T07:32:10.769 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/11 2024-09-16T07:32:10.808 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/11 2024-09-16T07:32:10.896 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 3/11 2024-09-16T07:32:11.024 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 4/11 2024-09-16T07:32:11.102 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 5/11 2024-09-16T07:32:11.187 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 6/11 2024-09-16T07:32:11.238 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 7/11 2024-09-16T07:32:11.266 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 8/11 2024-09-16T07:32:11.299 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4879.g81fedcb3.el9 9/11 2024-09-16T07:32:11.503 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 37/37 2024-09-16T07:32:11.504 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/37 2024-09-16T07:32:11.504 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/37 2024-09-16T07:32:11.504 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 3/37 2024-09-16T07:32:11.504 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/37 2024-09-16T07:32:11.504 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 5/37 2024-09-16T07:32:11.504 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4879.g81fedcb3.el9. 6/37 2024-09-16T07:32:11.504 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-16T07:32:11.504 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-16T07:32:11.504 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-16T07:32:11.504 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-16T07:32:11.504 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-16T07:32:11.504 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-16T07:32:11.504 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-16T07:32:11.505 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-16T07:32:11.505 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-16T07:32:11.505 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-16T07:32:11.505 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-16T07:32:11.505 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-16T07:32:11.505 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-16T07:32:11.505 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-16T07:32:11.505 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-16T07:32:11.505 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-16T07:32:11.505 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-16T07:32:11.505 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-16T07:32:11.505 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-16T07:32:11.506 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-16T07:32:11.507 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-16T07:32:11.507 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-16T07:32:11.507 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-16T07:32:11.507 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-16T07:32:11.507 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-16T07:32:11.507 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-16T07:32:11.507 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-16T07:32:11.507 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-16T07:32:11.507 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-16T07:32:11.507 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-16T07:32:12.469 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-16T07:32:12.469 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:32:12.469 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2024-09-16T07:32:12.469 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:32:12.470 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:32:12.470 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:32:12.470 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-modules-core-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T07:32:12.470 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:32:12.470 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:32:12.470 INFO:teuthology.orchestra.run.smithi121.stdout: lua-5.4.4-4.el9.x86_64 2024-09-16T07:32:12.470 INFO:teuthology.orchestra.run.smithi121.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-16T07:32:12.470 INFO:teuthology.orchestra.run.smithi121.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-16T07:32:12.470 INFO:teuthology.orchestra.run.smithi121.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-16T07:32:12.470 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-16T07:32:12.470 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-16T07:32:12.470 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-16T07:32:12.470 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-16T07:32:12.471 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-16T07:32:12.471 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-16T07:32:12.471 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-16T07:32:12.471 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-16T07:32:12.471 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-16T07:32:12.471 INFO:teuthology.orchestra.run.smithi121.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-16T07:32:12.471 INFO:teuthology.orchestra.run.smithi121.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-16T07:32:12.471 INFO:teuthology.orchestra.run.smithi121.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-16T07:32:12.471 INFO:teuthology.orchestra.run.smithi121.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-16T07:32:12.471 INFO:teuthology.orchestra.run.smithi121.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-16T07:32:12.471 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-16T07:32:12.471 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ply-3.11-14.el9.noarch 2024-09-16T07:32:12.471 INFO:teuthology.orchestra.run.smithi121.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-16T07:32:12.472 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-16T07:32:12.472 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-16T07:32:12.472 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-16T07:32:12.472 INFO:teuthology.orchestra.run.smithi121.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-16T07:32:12.472 INFO:teuthology.orchestra.run.smithi121.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-16T07:32:12.472 INFO:teuthology.orchestra.run.smithi121.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-16T07:32:12.472 INFO:teuthology.orchestra.run.smithi121.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-16T07:32:12.472 INFO:teuthology.orchestra.run.smithi121.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-16T07:32:12.472 INFO:teuthology.orchestra.run.smithi121.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-16T07:32:12.472 INFO:teuthology.orchestra.run.smithi121.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-16T07:32:12.472 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:32:12.472 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2024-09-16T07:32:12.754 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install ceph-base 2024-09-16T07:32:13.317 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:01:31 ago on Mon 16 Sep 2024 07:30:42 AM UTC. 2024-09-16T07:32:13.407 INFO:teuthology.orchestra.run.smithi121.stdout:Package ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T07:32:13.448 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2024-09-16T07:32:13.449 INFO:teuthology.orchestra.run.smithi121.stdout:Nothing to do. 2024-09-16T07:32:13.449 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2024-09-16T07:32:13.508 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install cephadm 2024-09-16T07:32:14.061 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:01:32 ago on Mon 16 Sep 2024 07:30:42 AM UTC. 2024-09-16T07:32:14.193 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2024-09-16T07:32:14.194 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-09-16T07:32:14.194 INFO:teuthology.orchestra.run.smithi121.stdout: Package Arch Version Repository Size 2024-09-16T07:32:14.194 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-09-16T07:32:14.194 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2024-09-16T07:32:14.194 INFO:teuthology.orchestra.run.smithi121.stdout: cephadm noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 785 k 2024-09-16T07:32:14.194 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:32:14.195 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2024-09-16T07:32:14.195 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-09-16T07:32:14.195 INFO:teuthology.orchestra.run.smithi121.stdout:Install 1 Package 2024-09-16T07:32:14.195 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:32:14.195 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 785 k 2024-09-16T07:32:14.195 INFO:teuthology.orchestra.run.smithi121.stdout:Installed size: 791 k 2024-09-16T07:32:14.195 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading Packages: 2024-09-16T07:32:14.448 INFO:teuthology.orchestra.run.smithi121.stdout:cephadm-19.3.0-4879.g81fedcb3.el9.noarch.rpm 3.0 MB/s | 785 kB 00:00 2024-09-16T07:32:14.449 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:32:14.449 INFO:teuthology.orchestra.run.smithi121.stdout:Total 3.0 MB/s | 785 kB 00:00 2024-09-16T07:32:14.449 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2024-09-16T07:32:14.454 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction check succeeded. 2024-09-16T07:32:14.455 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2024-09-16T07:32:14.460 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded. 2024-09-16T07:32:14.461 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2024-09-16T07:32:14.523 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4879.g81fedcb3.el 10/11 2024-09-16T07:32:14.535 INFO:teuthology.orchestra.run.smithi121.stdout: Preparing : 1/1 2024-09-16T07:32:14.579 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noa 11/11 2024-09-16T07:32:14.977 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T07:32:15.076 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T07:32:15.438 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T07:32:15.702 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T07:32:15.702 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:32:15.702 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2024-09-16T07:32:15.702 INFO:teuthology.orchestra.run.smithi121.stdout: cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T07:32:15.702 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:32:15.703 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2024-09-16T07:32:15.918 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install ceph-immutable-object-cache 2024-09-16T07:32:16.435 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noa 11/11 2024-09-16T07:32:16.435 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4879.g81fedcb3.el 1/11 2024-09-16T07:32:16.436 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noa 2/11 2024-09-16T07:32:16.436 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4879.g81fedcb3.el9 3/11 2024-09-16T07:32:16.436 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 4/11 2024-09-16T07:32:16.436 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 5/11 2024-09-16T07:32:16.436 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 6/11 2024-09-16T07:32:16.436 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 7/11 2024-09-16T07:32:16.436 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 8/11 2024-09-16T07:32:16.436 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/11 2024-09-16T07:32:16.436 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 10/11 2024-09-16T07:32:16.498 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:01:34 ago on Mon 16 Sep 2024 07:30:42 AM UTC. 2024-09-16T07:32:16.632 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2024-09-16T07:32:16.633 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-09-16T07:32:16.633 INFO:teuthology.orchestra.run.smithi121.stdout: Package Arch Version Repo Size 2024-09-16T07:32:16.633 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-09-16T07:32:16.633 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2024-09-16T07:32:16.633 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 158 k 2024-09-16T07:32:16.633 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:32:16.633 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2024-09-16T07:32:16.634 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-09-16T07:32:16.634 INFO:teuthology.orchestra.run.smithi121.stdout:Install 1 Package 2024-09-16T07:32:16.634 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:32:16.634 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 158 k 2024-09-16T07:32:16.634 INFO:teuthology.orchestra.run.smithi121.stdout:Installed size: 644 k 2024-09-16T07:32:16.634 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading Packages: 2024-09-16T07:32:16.742 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 11/11 2024-09-16T07:32:16.742 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:32:16.742 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-09-16T07:32:16.742 INFO:teuthology.orchestra.run.smithi172.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-16T07:32:16.743 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-grafana-dashboards-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T07:32:16.743 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T07:32:16.743 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-prometheus-alerts-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T07:32:16.743 INFO:teuthology.orchestra.run.smithi172.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-16T07:32:16.743 INFO:teuthology.orchestra.run.smithi172.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-16T07:32:16.743 INFO:teuthology.orchestra.run.smithi172.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-16T07:32:16.743 INFO:teuthology.orchestra.run.smithi172.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-16T07:32:16.743 INFO:teuthology.orchestra.run.smithi172.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-16T07:32:16.743 INFO:teuthology.orchestra.run.smithi172.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-16T07:32:16.743 INFO:teuthology.orchestra.run.smithi172.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-16T07:32:16.743 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:32:16.743 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-16T07:32:16.837 INFO:teuthology.orchestra.run.smithi121.stdout:ceph-immutable-object-cache-19.3.0-4879.g81fedc 776 kB/s | 158 kB 00:00 2024-09-16T07:32:16.838 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:32:16.838 INFO:teuthology.orchestra.run.smithi121.stdout:Total 770 kB/s | 158 kB 00:00 2024-09-16T07:32:16.838 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2024-09-16T07:32:16.848 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction check succeeded. 2024-09-16T07:32:16.848 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2024-09-16T07:32:16.905 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded. 2024-09-16T07:32:16.906 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2024-09-16T07:32:17.003 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-16T07:32:17.048 INFO:teuthology.orchestra.run.smithi121.stdout: Preparing : 1/1 2024-09-16T07:32:17.139 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3. 1/1 2024-09-16T07:32:17.163 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3. 1/1 2024-09-16T07:32:17.163 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T07:32:17.163 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-16T07:32:17.164 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:32:17.573 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:01:37 ago on Mon 16 Sep 2024 07:30:40 AM UTC. 2024-09-16T07:32:17.707 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-16T07:32:17.708 INFO:teuthology.orchestra.run.smithi172.stdout:======================================================================================= 2024-09-16T07:32:17.708 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repository Size 2024-09-16T07:32:17.708 INFO:teuthology.orchestra.run.smithi172.stdout:======================================================================================= 2024-09-16T07:32:17.708 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-09-16T07:32:17.708 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 7.4 M 2024-09-16T07:32:17.708 INFO:teuthology.orchestra.run.smithi172.stdout:Installing dependencies: 2024-09-16T07:32:17.708 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-16T07:32:17.709 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-16T07:32:17.709 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-16T07:32:17.709 INFO:teuthology.orchestra.run.smithi172.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-16T07:32:17.709 INFO:teuthology.orchestra.run.smithi172.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-16T07:32:17.709 INFO:teuthology.orchestra.run.smithi172.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-16T07:32:17.709 INFO:teuthology.orchestra.run.smithi172.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-16T07:32:17.709 INFO:teuthology.orchestra.run.smithi172.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-16T07:32:17.709 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-16T07:32:17.709 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-16T07:32:17.709 INFO:teuthology.orchestra.run.smithi172.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-16T07:32:17.709 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:32:17.709 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-09-16T07:32:17.710 INFO:teuthology.orchestra.run.smithi172.stdout:======================================================================================= 2024-09-16T07:32:17.710 INFO:teuthology.orchestra.run.smithi172.stdout:Install 12 Packages 2024-09-16T07:32:17.710 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:32:17.710 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 38 M 2024-09-16T07:32:17.710 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 212 M 2024-09-16T07:32:17.710 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-09-16T07:32:18.087 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3. 1/1 2024-09-16T07:32:18.087 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:32:18.087 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2024-09-16T07:32:18.087 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:32:18.087 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:32:18.087 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2024-09-16T07:32:18.290 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install ceph-mgr 2024-09-16T07:32:18.420 INFO:teuthology.orchestra.run.smithi172.stdout:(1/12): ceph-mgr-diskprediction-local-19.3.0-48 15 MB/s | 7.4 MB 00:00 2024-09-16T07:32:18.484 INFO:teuthology.orchestra.run.smithi172.stdout:(2/12): libquadmath-11.5.0-2.el9.x86_64.rpm 347 kB/s | 191 kB 00:00 2024-09-16T07:32:18.527 INFO:teuthology.orchestra.run.smithi172.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 304 kB/s | 33 kB 00:00 2024-09-16T07:32:18.577 INFO:teuthology.orchestra.run.smithi172.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 364 kB/s | 18 kB 00:00 2024-09-16T07:32:18.635 INFO:teuthology.orchestra.run.smithi172.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 657 kB/s | 38 kB 00:00 2024-09-16T07:32:18.761 INFO:teuthology.orchestra.run.smithi172.stdout:(6/12): libgfortran-11.5.0-2.el9.x86_64.rpm 969 kB/s | 801 kB 00:00 2024-09-16T07:32:18.836 INFO:teuthology.orchestra.run.smithi172.stdout:(7/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 8.5 MB/s | 3.0 MB 00:00 2024-09-16T07:32:18.864 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:01:36 ago on Mon 16 Sep 2024 07:30:42 AM UTC. 2024-09-16T07:32:18.961 INFO:teuthology.orchestra.run.smithi121.stdout:Package ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T07:32:18.978 INFO:teuthology.orchestra.run.smithi172.stdout:(8/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 36 MB/s | 5.1 MB 00:00 2024-09-16T07:32:19.003 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2024-09-16T07:32:19.005 INFO:teuthology.orchestra.run.smithi121.stdout:Nothing to do. 2024-09-16T07:32:19.005 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2024-09-16T07:32:19.053 INFO:teuthology.orchestra.run.smithi172.stdout:(9/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 12 MB/s | 4.9 MB 00:00 2024-09-16T07:32:19.079 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install ceph-mgr-dashboard 2024-09-16T07:32:19.080 INFO:teuthology.orchestra.run.smithi172.stdout:(10/12): python3-devel-3.9.19-8.el9.x86_64.rpm 772 kB/s | 245 kB 00:00 2024-09-16T07:32:19.104 INFO:teuthology.orchestra.run.smithi172.stdout:(11/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 2.0 MB/s | 250 kB 00:00 2024-09-16T07:32:19.363 INFO:teuthology.orchestra.run.smithi172.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 53 MB/s | 16 MB 00:00 2024-09-16T07:32:19.363 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:32:19.363 INFO:teuthology.orchestra.run.smithi172.stdout:Total 23 MB/s | 38 MB 00:01 2024-09-16T07:32:19.638 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:01:37 ago on Mon 16 Sep 2024 07:30:42 AM UTC. 2024-09-16T07:32:19.715 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-09-16T07:32:19.741 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-09-16T07:32:19.741 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-09-16T07:32:19.771 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2024-09-16T07:32:19.772 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-09-16T07:32:19.772 INFO:teuthology.orchestra.run.smithi121.stdout: Package Arch Version Repository Size 2024-09-16T07:32:19.772 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-09-16T07:32:19.772 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2024-09-16T07:32:19.772 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 14 M 2024-09-16T07:32:19.772 INFO:teuthology.orchestra.run.smithi121.stdout:Installing dependencies: 2024-09-16T07:32:19.772 INFO:teuthology.orchestra.run.smithi121.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-16T07:32:19.773 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 34 k 2024-09-16T07:32:19.773 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 16 k 2024-09-16T07:32:19.773 INFO:teuthology.orchestra.run.smithi121.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-16T07:32:19.773 INFO:teuthology.orchestra.run.smithi121.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-16T07:32:19.773 INFO:teuthology.orchestra.run.smithi121.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-16T07:32:19.773 INFO:teuthology.orchestra.run.smithi121.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-16T07:32:19.773 INFO:teuthology.orchestra.run.smithi121.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-16T07:32:19.773 INFO:teuthology.orchestra.run.smithi121.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-16T07:32:19.774 INFO:teuthology.orchestra.run.smithi121.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-16T07:32:19.774 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:32:19.774 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2024-09-16T07:32:19.774 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-09-16T07:32:19.774 INFO:teuthology.orchestra.run.smithi121.stdout:Install 11 Packages 2024-09-16T07:32:19.774 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:32:19.774 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 18 M 2024-09-16T07:32:19.775 INFO:teuthology.orchestra.run.smithi121.stdout:Installed size: 155 M 2024-09-16T07:32:19.775 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading Packages: 2024-09-16T07:32:20.190 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-09-16T07:32:20.190 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-09-16T07:32:20.358 INFO:teuthology.orchestra.run.smithi121.stdout:(1/11): ceph-grafana-dashboards-19.3.0-4879.g81 221 kB/s | 34 kB 00:00 2024-09-16T07:32:20.383 INFO:teuthology.orchestra.run.smithi121.stdout:(2/11): ceph-prometheus-alerts-19.3.0-4879.g81f 91 kB/s | 16 kB 00:00 2024-09-16T07:32:20.551 INFO:teuthology.orchestra.run.smithi121.stdout:(3/11): python3-protobuf-3.14.0-13.el9.noarch.r 1.4 MB/s | 269 kB 00:00 2024-09-16T07:32:20.593 INFO:teuthology.orchestra.run.smithi121.stdout:(4/11): protobuf-compiler-3.14.0-13.el9.x86_64. 4.0 MB/s | 863 kB 00:00 2024-09-16T07:32:20.634 INFO:teuthology.orchestra.run.smithi121.stdout:(5/11): abseil-cpp-20211102.0-3.el9.x86_64.rpm 6.4 MB/s | 548 kB 00:00 2024-09-16T07:32:20.660 INFO:teuthology.orchestra.run.smithi121.stdout:(6/11): grpc-data-1.46.7-10.el9.noarch.rpm 297 kB/s | 19 kB 00:00 2024-09-16T07:32:20.694 INFO:teuthology.orchestra.run.smithi121.stdout:(7/11): python3-grpcio-tools-1.46.7-10.el9.x86_ 4.3 MB/s | 144 kB 00:00 2024-09-16T07:32:20.719 INFO:teuthology.orchestra.run.smithi121.stdout:(8/11): python3-repoze-lru-0.7-16.el9.noarch.rp 1.2 MB/s | 31 kB 00:00 2024-09-16T07:32:20.769 INFO:teuthology.orchestra.run.smithi121.stdout:(9/11): python3-grpcio-1.46.7-10.el9.x86_64.rpm 15 MB/s | 2.0 MB 00:00 2024-09-16T07:32:20.794 INFO:teuthology.orchestra.run.smithi121.stdout:(10/11): python3-routes-2.5.1-5.el9.noarch.rpm 2.5 MB/s | 188 kB 00:00 2024-09-16T07:32:20.969 INFO:teuthology.orchestra.run.smithi121.stdout:(11/11): ceph-mgr-dashboard-19.3.0-4879.g81fedc 18 MB/s | 14 MB 00:00 2024-09-16T07:32:20.971 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-09-16T07:32:20.973 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:32:20.974 INFO:teuthology.orchestra.run.smithi121.stdout:Total 15 MB/s | 18 MB 00:01 2024-09-16T07:32:21.004 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2024-09-16T07:32:21.022 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction check succeeded. 2024-09-16T07:32:21.022 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2024-09-16T07:32:21.058 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-16T07:32:21.102 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-16T07:32:21.201 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-16T07:32:21.236 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-16T07:32:21.288 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded. 2024-09-16T07:32:21.289 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2024-09-16T07:32:21.423 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-16T07:32:21.460 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-16T07:32:21.537 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-16T07:32:21.831 INFO:teuthology.orchestra.run.smithi121.stdout: Preparing : 1/1 2024-09-16T07:32:21.910 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/11 2024-09-16T07:32:21.939 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/11 2024-09-16T07:32:22.027 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 3/11 2024-09-16T07:32:22.157 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 4/11 2024-09-16T07:32:22.201 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 5/11 2024-09-16T07:32:22.241 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-16T07:32:22.285 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 6/11 2024-09-16T07:32:22.336 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 7/11 2024-09-16T07:32:22.365 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 8/11 2024-09-16T07:32:22.365 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-16T07:32:22.397 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4879.g81fedcb3.el9 9/11 2024-09-16T07:32:23.613 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-16T07:32:24.668 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-16T07:32:24.700 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fed 12/12 2024-09-16T07:32:25.569 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4879.g81fedcb3.el 10/11 2024-09-16T07:32:25.635 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noa 11/11 2024-09-16T07:32:27.298 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fed 12/12 2024-09-16T07:32:27.298 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fed 1/12 2024-09-16T07:32:27.299 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-16T07:32:27.299 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-16T07:32:27.299 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-16T07:32:27.299 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-16T07:32:27.299 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-16T07:32:27.299 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-16T07:32:27.299 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-16T07:32:27.299 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-16T07:32:27.299 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-16T07:32:27.299 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-16T07:32:27.375 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noa 11/11 2024-09-16T07:32:27.375 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4879.g81fedcb3.el 1/11 2024-09-16T07:32:27.375 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noa 2/11 2024-09-16T07:32:27.375 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4879.g81fedcb3.el9 3/11 2024-09-16T07:32:27.376 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 4/11 2024-09-16T07:32:27.376 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 5/11 2024-09-16T07:32:27.376 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 6/11 2024-09-16T07:32:27.376 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 7/11 2024-09-16T07:32:27.376 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 8/11 2024-09-16T07:32:27.376 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/11 2024-09-16T07:32:27.376 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 10/11 2024-09-16T07:32:27.684 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 11/11 2024-09-16T07:32:27.684 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:32:27.684 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2024-09-16T07:32:27.684 INFO:teuthology.orchestra.run.smithi121.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-16T07:32:27.684 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-grafana-dashboards-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T07:32:27.685 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T07:32:27.685 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-prometheus-alerts-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T07:32:27.685 INFO:teuthology.orchestra.run.smithi121.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-16T07:32:27.685 INFO:teuthology.orchestra.run.smithi121.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-16T07:32:27.685 INFO:teuthology.orchestra.run.smithi121.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-16T07:32:27.685 INFO:teuthology.orchestra.run.smithi121.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-16T07:32:27.685 INFO:teuthology.orchestra.run.smithi121.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-16T07:32:27.685 INFO:teuthology.orchestra.run.smithi121.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-16T07:32:27.685 INFO:teuthology.orchestra.run.smithi121.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-16T07:32:27.685 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:32:27.685 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2024-09-16T07:32:27.741 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-16T07:32:27.741 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:32:27.741 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-09-16T07:32:27.741 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T07:32:27.741 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-16T07:32:27.741 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-16T07:32:27.741 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-16T07:32:27.741 INFO:teuthology.orchestra.run.smithi172.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-16T07:32:27.741 INFO:teuthology.orchestra.run.smithi172.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-16T07:32:27.741 INFO:teuthology.orchestra.run.smithi172.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-16T07:32:27.742 INFO:teuthology.orchestra.run.smithi172.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-16T07:32:27.742 INFO:teuthology.orchestra.run.smithi172.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-16T07:32:27.742 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-16T07:32:27.742 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-16T07:32:27.742 INFO:teuthology.orchestra.run.smithi172.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-16T07:32:27.742 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:32:27.742 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-16T07:32:27.922 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-16T07:32:28.197 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-mgr-rook 2024-09-16T07:32:28.480 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:01:46 ago on Mon 16 Sep 2024 07:30:42 AM UTC. 2024-09-16T07:32:28.614 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2024-09-16T07:32:28.615 INFO:teuthology.orchestra.run.smithi121.stdout:======================================================================================= 2024-09-16T07:32:28.615 INFO:teuthology.orchestra.run.smithi121.stdout: Package Arch Version Repository Size 2024-09-16T07:32:28.615 INFO:teuthology.orchestra.run.smithi121.stdout:======================================================================================= 2024-09-16T07:32:28.616 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2024-09-16T07:32:28.616 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 7.4 M 2024-09-16T07:32:28.616 INFO:teuthology.orchestra.run.smithi121.stdout:Installing dependencies: 2024-09-16T07:32:28.616 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-16T07:32:28.616 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-16T07:32:28.616 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-16T07:32:28.616 INFO:teuthology.orchestra.run.smithi121.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-16T07:32:28.616 INFO:teuthology.orchestra.run.smithi121.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-16T07:32:28.616 INFO:teuthology.orchestra.run.smithi121.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-16T07:32:28.616 INFO:teuthology.orchestra.run.smithi121.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-16T07:32:28.616 INFO:teuthology.orchestra.run.smithi121.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-16T07:32:28.616 INFO:teuthology.orchestra.run.smithi121.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-16T07:32:28.616 INFO:teuthology.orchestra.run.smithi121.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-16T07:32:28.617 INFO:teuthology.orchestra.run.smithi121.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-16T07:32:28.617 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:32:28.617 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2024-09-16T07:32:28.617 INFO:teuthology.orchestra.run.smithi121.stdout:======================================================================================= 2024-09-16T07:32:28.617 INFO:teuthology.orchestra.run.smithi121.stdout:Install 12 Packages 2024-09-16T07:32:28.617 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:32:28.617 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 38 M 2024-09-16T07:32:28.618 INFO:teuthology.orchestra.run.smithi121.stdout:Installed size: 212 M 2024-09-16T07:32:28.618 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading Packages: 2024-09-16T07:32:28.781 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:01:48 ago on Mon 16 Sep 2024 07:30:40 AM UTC. 2024-09-16T07:32:28.916 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-16T07:32:28.917 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T07:32:28.917 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repository Size 2024-09-16T07:32:28.917 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T07:32:28.917 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-09-16T07:32:28.917 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-rook noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 49 k 2024-09-16T07:32:28.917 INFO:teuthology.orchestra.run.smithi172.stdout:Installing dependencies: 2024-09-16T07:32:28.918 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-16T07:32:28.918 INFO:teuthology.orchestra.run.smithi172.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-16T07:32:28.918 INFO:teuthology.orchestra.run.smithi172.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-16T07:32:28.918 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-16T07:32:28.918 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-16T07:32:28.918 INFO:teuthology.orchestra.run.smithi172.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-16T07:32:28.918 INFO:teuthology.orchestra.run.smithi172.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-16T07:32:28.918 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-16T07:32:28.918 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-16T07:32:28.918 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-16T07:32:28.918 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-16T07:32:28.918 INFO:teuthology.orchestra.run.smithi172.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-16T07:32:28.918 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:32:28.918 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-09-16T07:32:28.919 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T07:32:28.919 INFO:teuthology.orchestra.run.smithi172.stdout:Install 13 Packages 2024-09-16T07:32:28.919 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:32:28.919 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 2.2 M 2024-09-16T07:32:28.919 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 26 M 2024-09-16T07:32:28.919 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-09-16T07:32:29.017 INFO:teuthology.orchestra.run.smithi121.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.8 MB/s | 191 kB 00:00 2024-09-16T07:32:29.050 INFO:teuthology.orchestra.run.smithi121.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 5.8 MB/s | 801 kB 00:00 2024-09-16T07:32:29.117 INFO:teuthology.orchestra.run.smithi121.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 327 kB/s | 33 kB 00:00 2024-09-16T07:32:29.159 INFO:teuthology.orchestra.run.smithi121.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 437 kB/s | 18 kB 00:00 2024-09-16T07:32:29.209 INFO:teuthology.orchestra.run.smithi121.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 771 kB/s | 38 kB 00:00 2024-09-16T07:32:29.277 INFO:teuthology.orchestra.run.smithi121.stdout:(6/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 13 MB/s | 3.0 MB 00:00 2024-09-16T07:32:29.319 INFO:teuthology.orchestra.run.smithi121.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 5.8 MB/s | 245 kB 00:00 2024-09-16T07:32:29.450 INFO:teuthology.orchestra.run.smithi172.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 231 kB/s | 19 kB 00:00 2024-09-16T07:32:29.452 INFO:teuthology.orchestra.run.smithi121.stdout:(8/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 38 MB/s | 5.1 MB 00:00 2024-09-16T07:32:29.475 INFO:teuthology.orchestra.run.smithi172.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 237 kB/s | 26 kB 00:00 2024-09-16T07:32:29.544 INFO:teuthology.orchestra.run.smithi121.stdout:(9/12): ceph-mgr-diskprediction-local-19.3.0-48 12 MB/s | 7.4 MB 00:00 2024-09-16T07:32:29.550 INFO:teuthology.orchestra.run.smithi172.stdout:(3/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-09-16T07:32:29.569 INFO:teuthology.orchestra.run.smithi121.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 2.1 MB/s | 250 kB 00:00 2024-09-16T07:32:29.575 INFO:teuthology.orchestra.run.smithi172.stdout:(4/13): ceph-mgr-rook-19.3.0-4879.g81fedcb3.el9 236 kB/s | 49 kB 00:00 2024-09-16T07:32:29.601 INFO:teuthology.orchestra.run.smithi172.stdout:(5/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.4 MB/s | 222 kB 00:00 2024-09-16T07:32:29.643 INFO:teuthology.orchestra.run.smithi172.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.3 MB/s | 54 kB 00:00 2024-09-16T07:32:29.644 INFO:teuthology.orchestra.run.smithi121.stdout:(11/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 11 MB/s | 4.9 MB 00:00 2024-09-16T07:32:29.668 INFO:teuthology.orchestra.run.smithi172.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 2.3 MB/s | 279 kB 00:00 2024-09-16T07:32:29.702 INFO:teuthology.orchestra.run.smithi172.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 320 kB/s | 32 kB 00:00 2024-09-16T07:32:29.727 INFO:teuthology.orchestra.run.smithi172.stdout:(9/13): python3-google-auth-2.34.0-1.el9.noarch 4.1 MB/s | 220 kB 00:00 2024-09-16T07:32:29.761 INFO:teuthology.orchestra.run.smithi172.stdout:(10/13): python3-certifi-2023.05.07-4.el9.noarc 120 kB/s | 14 kB 00:00 2024-09-16T07:32:29.786 INFO:teuthology.orchestra.run.smithi172.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-16T07:32:29.811 INFO:teuthology.orchestra.run.smithi172.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.8 MB/s | 90 kB 00:00 2024-09-16T07:32:29.845 INFO:teuthology.orchestra.run.smithi172.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 7.2 MB/s | 1.0 MB 00:00 2024-09-16T07:32:29.847 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:32:29.848 INFO:teuthology.orchestra.run.smithi172.stdout:Total 2.4 MB/s | 2.2 MB 00:00 2024-09-16T07:32:29.912 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-09-16T07:32:29.927 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-09-16T07:32:29.927 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-09-16T07:32:29.990 INFO:teuthology.orchestra.run.smithi121.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 37 MB/s | 16 MB 00:00 2024-09-16T07:32:29.991 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:32:29.991 INFO:teuthology.orchestra.run.smithi121.stdout:Total 28 MB/s | 38 MB 00:01 2024-09-16T07:32:30.018 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-09-16T07:32:30.018 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-09-16T07:32:30.339 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2024-09-16T07:32:30.366 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction check succeeded. 2024-09-16T07:32:30.366 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2024-09-16T07:32:30.532 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-09-16T07:32:30.708 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-16T07:32:30.762 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-16T07:32:30.806 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded. 2024-09-16T07:32:30.806 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2024-09-16T07:32:30.817 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-16T07:32:30.855 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-16T07:32:30.896 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-16T07:32:30.998 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-16T07:32:31.109 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-16T07:32:31.165 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-16T07:32:31.616 INFO:teuthology.orchestra.run.smithi121.stdout: Preparing : 1/1 2024-09-16T07:32:31.668 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-16T07:32:31.709 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-16T07:32:31.813 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-16T07:32:31.852 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-16T07:32:31.877 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-16T07:32:31.937 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-16T07:32:31.970 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-16T07:32:32.018 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-16T07:32:32.028 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-16T07:32:32.040 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 13/13 2024-09-16T07:32:32.068 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-16T07:32:32.149 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-16T07:32:32.806 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 13/13 2024-09-16T07:32:32.807 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 1/13 2024-09-16T07:32:32.807 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-16T07:32:32.807 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-16T07:32:32.807 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-16T07:32:32.807 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-16T07:32:32.807 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-16T07:32:32.807 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-16T07:32:32.808 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-16T07:32:32.808 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-16T07:32:32.808 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-16T07:32:32.808 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-16T07:32:32.808 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-16T07:32:32.809 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-16T07:32:32.924 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-16T07:32:33.174 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-16T07:32:33.174 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:32:33.174 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-09-16T07:32:33.174 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T07:32:33.175 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-16T07:32:33.175 INFO:teuthology.orchestra.run.smithi172.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-16T07:32:33.175 INFO:teuthology.orchestra.run.smithi172.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-16T07:32:33.175 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-16T07:32:33.175 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-16T07:32:33.175 INFO:teuthology.orchestra.run.smithi172.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-16T07:32:33.175 INFO:teuthology.orchestra.run.smithi172.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-16T07:32:33.175 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-16T07:32:33.175 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-16T07:32:33.175 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-16T07:32:33.175 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-16T07:32:33.176 INFO:teuthology.orchestra.run.smithi172.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-16T07:32:33.176 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:32:33.176 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-16T07:32:33.463 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-mgr-cephadm 2024-09-16T07:32:34.052 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:01:54 ago on Mon 16 Sep 2024 07:30:40 AM UTC. 2024-09-16T07:32:34.187 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-16T07:32:34.188 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T07:32:34.188 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repository Size 2024-09-16T07:32:34.188 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T07:32:34.189 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-09-16T07:32:34.189 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 154 k 2024-09-16T07:32:34.189 INFO:teuthology.orchestra.run.smithi172.stdout:Installing dependencies: 2024-09-16T07:32:34.189 INFO:teuthology.orchestra.run.smithi172.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-16T07:32:34.189 INFO:teuthology.orchestra.run.smithi172.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-16T07:32:34.189 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-16T07:32:34.189 INFO:teuthology.orchestra.run.smithi172.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-16T07:32:34.189 INFO:teuthology.orchestra.run.smithi172.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-16T07:32:34.189 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:32:34.189 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-09-16T07:32:34.189 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T07:32:34.189 INFO:teuthology.orchestra.run.smithi172.stdout:Install 6 Packages 2024-09-16T07:32:34.189 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:32:34.190 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-16T07:32:34.190 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 7.0 M 2024-09-16T07:32:34.190 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 33 M 2024-09-16T07:32:34.191 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-09-16T07:32:34.688 INFO:teuthology.orchestra.run.smithi172.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.4 MB/s | 248 kB 00:00 2024-09-16T07:32:34.713 INFO:teuthology.orchestra.run.smithi172.stdout:(2/6): ceph-mgr-cephadm-19.3.0-4879.g81fedcb3.e 754 kB/s | 154 kB 00:00 2024-09-16T07:32:34.772 INFO:teuthology.orchestra.run.smithi172.stdout:(3/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 6.4 MB/s | 548 kB 00:00 2024-09-16T07:32:34.797 INFO:teuthology.orchestra.run.smithi172.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 690 kB/s | 58 kB 00:00 2024-09-16T07:32:34.822 INFO:teuthology.orchestra.run.smithi172.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.5 MB/s | 74 kB 00:00 2024-09-16T07:32:35.229 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-16T07:32:35.251 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fed 12/12 2024-09-16T07:32:35.864 INFO:teuthology.orchestra.run.smithi172.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 4.4 MB/s | 6.0 MB 00:01 2024-09-16T07:32:35.867 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:32:35.867 INFO:teuthology.orchestra.run.smithi172.stdout:Total 4.2 MB/s | 7.0 MB 00:01 2024-09-16T07:32:35.939 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-09-16T07:32:35.950 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-09-16T07:32:35.951 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-09-16T07:32:36.051 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-09-16T07:32:36.052 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-09-16T07:32:36.360 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-09-16T07:32:36.521 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-16T07:32:36.583 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-16T07:32:37.108 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-16T07:32:37.193 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-16T07:32:37.261 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-16T07:32:37.286 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 6/6 2024-09-16T07:32:37.860 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fed 12/12 2024-09-16T07:32:37.860 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fed 1/12 2024-09-16T07:32:37.860 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-16T07:32:37.860 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-16T07:32:37.860 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-16T07:32:37.860 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-16T07:32:37.860 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-16T07:32:37.860 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-16T07:32:37.860 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-16T07:32:37.861 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-16T07:32:37.861 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-16T07:32:37.861 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-16T07:32:38.080 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 6/6 2024-09-16T07:32:38.081 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/6 2024-09-16T07:32:38.081 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-16T07:32:38.081 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-16T07:32:38.081 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-16T07:32:38.081 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-16T07:32:38.286 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-16T07:32:38.286 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:32:38.286 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2024-09-16T07:32:38.287 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T07:32:38.287 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-16T07:32:38.287 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-16T07:32:38.287 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-16T07:32:38.287 INFO:teuthology.orchestra.run.smithi121.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-16T07:32:38.287 INFO:teuthology.orchestra.run.smithi121.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-16T07:32:38.287 INFO:teuthology.orchestra.run.smithi121.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-16T07:32:38.287 INFO:teuthology.orchestra.run.smithi121.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-16T07:32:38.287 INFO:teuthology.orchestra.run.smithi121.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-16T07:32:38.287 INFO:teuthology.orchestra.run.smithi121.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-16T07:32:38.287 INFO:teuthology.orchestra.run.smithi121.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-16T07:32:38.287 INFO:teuthology.orchestra.run.smithi121.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-16T07:32:38.288 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:32:38.288 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2024-09-16T07:32:38.362 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-16T07:32:38.362 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:32:38.362 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-09-16T07:32:38.362 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T07:32:38.362 INFO:teuthology.orchestra.run.smithi172.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-16T07:32:38.362 INFO:teuthology.orchestra.run.smithi172.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-16T07:32:38.362 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-16T07:32:38.362 INFO:teuthology.orchestra.run.smithi172.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-16T07:32:38.362 INFO:teuthology.orchestra.run.smithi172.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-16T07:32:38.362 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:32:38.363 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-16T07:32:38.619 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-fuse 2024-09-16T07:32:38.676 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install ceph-mgr-rook 2024-09-16T07:32:39.188 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:01:59 ago on Mon 16 Sep 2024 07:30:40 AM UTC. 2024-09-16T07:32:39.253 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:01:57 ago on Mon 16 Sep 2024 07:30:42 AM UTC. 2024-09-16T07:32:39.323 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-16T07:32:39.324 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T07:32:39.324 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repository Size 2024-09-16T07:32:39.324 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T07:32:39.324 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-09-16T07:32:39.324 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-fuse x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 884 k 2024-09-16T07:32:39.324 INFO:teuthology.orchestra.run.smithi172.stdout:Installing dependencies: 2024-09-16T07:32:39.325 INFO:teuthology.orchestra.run.smithi172.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-16T07:32:39.325 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:32:39.325 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-09-16T07:32:39.325 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T07:32:39.325 INFO:teuthology.orchestra.run.smithi172.stdout:Install 2 Packages 2024-09-16T07:32:39.325 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:32:39.325 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 964 k 2024-09-16T07:32:39.326 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 4.1 M 2024-09-16T07:32:39.326 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-09-16T07:32:39.388 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2024-09-16T07:32:39.389 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-09-16T07:32:39.389 INFO:teuthology.orchestra.run.smithi121.stdout: Package Arch Version Repository Size 2024-09-16T07:32:39.389 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-09-16T07:32:39.389 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2024-09-16T07:32:39.389 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-rook noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 49 k 2024-09-16T07:32:39.390 INFO:teuthology.orchestra.run.smithi121.stdout:Installing dependencies: 2024-09-16T07:32:39.390 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-16T07:32:39.390 INFO:teuthology.orchestra.run.smithi121.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-16T07:32:39.390 INFO:teuthology.orchestra.run.smithi121.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-16T07:32:39.390 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-16T07:32:39.390 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-16T07:32:39.390 INFO:teuthology.orchestra.run.smithi121.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-16T07:32:39.390 INFO:teuthology.orchestra.run.smithi121.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-16T07:32:39.390 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-16T07:32:39.390 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-16T07:32:39.390 INFO:teuthology.orchestra.run.smithi121.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-16T07:32:39.390 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-16T07:32:39.391 INFO:teuthology.orchestra.run.smithi121.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-16T07:32:39.391 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:32:39.391 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2024-09-16T07:32:39.391 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-09-16T07:32:39.391 INFO:teuthology.orchestra.run.smithi121.stdout:Install 13 Packages 2024-09-16T07:32:39.391 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:32:39.391 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 2.2 M 2024-09-16T07:32:39.392 INFO:teuthology.orchestra.run.smithi121.stdout:Installed size: 26 M 2024-09-16T07:32:39.392 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading Packages: 2024-09-16T07:32:39.719 INFO:teuthology.orchestra.run.smithi121.stdout:(1/13): ceph-mgr-rook-19.3.0-4879.g81fedcb3.el9 310 kB/s | 49 kB 00:00 2024-09-16T07:32:39.724 INFO:teuthology.orchestra.run.smithi172.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 665 kB/s | 80 kB 00:00 2024-09-16T07:32:39.853 INFO:teuthology.orchestra.run.smithi121.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 88 kB/s | 26 kB 00:00 2024-09-16T07:32:39.869 INFO:teuthology.orchestra.run.smithi121.stdout:(3/13): python3-jsonpointer-2.0-4.el9.noarch.rp 62 kB/s | 19 kB 00:00 2024-09-16T07:32:39.883 INFO:teuthology.orchestra.run.smithi172.stdout:(2/2): ceph-fuse-19.3.0-4879.g81fedcb3.el9.x86_ 3.1 MB/s | 884 kB 00:00 2024-09-16T07:32:39.883 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:32:39.883 INFO:teuthology.orchestra.run.smithi172.stdout:Total 1.7 MB/s | 964 kB 00:00 2024-09-16T07:32:39.895 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-09-16T07:32:39.921 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-09-16T07:32:39.921 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-09-16T07:32:40.004 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-09-16T07:32:40.004 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-09-16T07:32:40.196 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-09-16T07:32:40.245 INFO:teuthology.orchestra.run.smithi121.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 423 kB/s | 159 kB 00:00 2024-09-16T07:32:40.270 INFO:teuthology.orchestra.run.smithi121.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 696 kB/s | 279 kB 00:00 2024-09-16T07:32:40.304 INFO:teuthology.orchestra.run.smithi121.stdout:(6/13): python3-cachetools-4.2.4-1.el9.noarch.r 974 kB/s | 32 kB 00:00 2024-09-16T07:32:40.321 INFO:teuthology.orchestra.run.smithi121.stdout:(7/13): python3-certifi-2023.05.07-4.el9.noarch 840 kB/s | 14 kB 00:00 2024-09-16T07:32:40.352 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-16T07:32:40.354 INFO:teuthology.orchestra.run.smithi121.stdout:(8/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 350 kB/s | 222 kB 00:00 2024-09-16T07:32:40.380 INFO:teuthology.orchestra.run.smithi121.stdout:(9/13): python3-google-auth-2.34.0-1.el9.noarch 3.7 MB/s | 220 kB 00:00 2024-09-16T07:32:40.405 INFO:teuthology.orchestra.run.smithi121.stdout:(10/13): python3-requests-oauthlib-1.3.0-12.el9 336 kB/s | 54 kB 00:00 2024-09-16T07:32:40.423 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/2 2024-09-16T07:32:40.438 INFO:teuthology.orchestra.run.smithi121.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-09-16T07:32:40.464 INFO:teuthology.orchestra.run.smithi121.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.7 MB/s | 90 kB 00:00 2024-09-16T07:32:40.497 INFO:teuthology.orchestra.run.smithi121.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 7.2 MB/s | 1.0 MB 00:00 2024-09-16T07:32:40.500 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:32:40.500 INFO:teuthology.orchestra.run.smithi121.stdout:Total 2.0 MB/s | 2.2 MB 00:01 2024-09-16T07:32:40.566 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2024-09-16T07:32:40.581 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction check succeeded. 2024-09-16T07:32:40.581 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2024-09-16T07:32:40.668 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded. 2024-09-16T07:32:40.669 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2024-09-16T07:32:41.113 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/2 2024-09-16T07:32:41.114 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/2 2024-09-16T07:32:41.169 INFO:teuthology.orchestra.run.smithi121.stdout: Preparing : 1/1 2024-09-16T07:32:41.355 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-16T07:32:41.383 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-16T07:32:41.384 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:32:41.384 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-09-16T07:32:41.384 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-16T07:32:41.384 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:32:41.384 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-16T07:32:41.407 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-16T07:32:41.463 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-16T07:32:41.499 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-16T07:32:41.541 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-16T07:32:41.643 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-16T07:32:41.694 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-volume 2024-09-16T07:32:41.762 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-16T07:32:41.818 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-16T07:32:42.282 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:02:02 ago on Mon 16 Sep 2024 07:30:40 AM UTC. 2024-09-16T07:32:42.419 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-16T07:32:42.420 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T07:32:42.420 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repository Size 2024-09-16T07:32:42.420 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T07:32:42.420 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-09-16T07:32:42.421 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-volume noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 285 k 2024-09-16T07:32:42.421 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:32:42.421 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-09-16T07:32:42.421 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T07:32:42.421 INFO:teuthology.orchestra.run.smithi172.stdout:Install 1 Package 2024-09-16T07:32:42.421 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:32:42.421 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 285 k 2024-09-16T07:32:42.421 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 1.3 M 2024-09-16T07:32:42.421 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-09-16T07:32:42.550 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-16T07:32:42.615 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-16T07:32:42.637 INFO:teuthology.orchestra.run.smithi172.stdout:ceph-volume-19.3.0-4879.g81fedcb3.el9.noarch.rp 1.3 MB/s | 285 kB 00:00 2024-09-16T07:32:42.638 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:32:42.638 INFO:teuthology.orchestra.run.smithi172.stdout:Total 1.3 MB/s | 285 kB 00:00 2024-09-16T07:32:42.638 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-09-16T07:32:42.646 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-09-16T07:32:42.646 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-09-16T07:32:42.649 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-16T07:32:42.680 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-09-16T07:32:42.680 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-09-16T07:32:42.697 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-16T07:32:42.726 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 13/13 2024-09-16T07:32:42.903 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-09-16T07:32:43.005 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T07:32:43.022 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T07:32:43.022 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T07:32:43.022 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-16T07:32:43.022 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:32:43.478 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 13/13 2024-09-16T07:32:43.478 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 1/13 2024-09-16T07:32:43.479 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-16T07:32:43.479 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-16T07:32:43.479 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-16T07:32:43.479 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-16T07:32:43.479 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-16T07:32:43.479 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-16T07:32:43.479 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-16T07:32:43.479 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-16T07:32:43.480 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-16T07:32:43.480 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-16T07:32:43.480 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-16T07:32:43.822 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-16T07:32:43.822 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:32:43.822 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2024-09-16T07:32:43.822 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T07:32:43.822 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-16T07:32:43.822 INFO:teuthology.orchestra.run.smithi121.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-16T07:32:43.822 INFO:teuthology.orchestra.run.smithi121.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-16T07:32:43.822 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-16T07:32:43.822 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-16T07:32:43.822 INFO:teuthology.orchestra.run.smithi121.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-16T07:32:43.823 INFO:teuthology.orchestra.run.smithi121.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-16T07:32:43.823 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-16T07:32:43.823 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-16T07:32:43.823 INFO:teuthology.orchestra.run.smithi121.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-16T07:32:43.823 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-16T07:32:43.823 INFO:teuthology.orchestra.run.smithi121.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-16T07:32:43.823 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:32:43.823 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2024-09-16T07:32:44.019 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T07:32:44.020 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:32:44.020 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-09-16T07:32:44.020 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T07:32:44.020 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:32:44.020 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-16T07:32:44.062 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install ceph-mgr-cephadm 2024-09-16T07:32:44.319 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install librados-devel 2024-09-16T07:32:44.630 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:02:02 ago on Mon 16 Sep 2024 07:30:42 AM UTC. 2024-09-16T07:32:44.763 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2024-09-16T07:32:44.764 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-09-16T07:32:44.764 INFO:teuthology.orchestra.run.smithi121.stdout: Package Arch Version Repository Size 2024-09-16T07:32:44.764 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-09-16T07:32:44.765 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2024-09-16T07:32:44.765 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 154 k 2024-09-16T07:32:44.765 INFO:teuthology.orchestra.run.smithi121.stdout:Installing dependencies: 2024-09-16T07:32:44.765 INFO:teuthology.orchestra.run.smithi121.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-16T07:32:44.765 INFO:teuthology.orchestra.run.smithi121.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-16T07:32:44.765 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-16T07:32:44.765 INFO:teuthology.orchestra.run.smithi121.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-16T07:32:44.765 INFO:teuthology.orchestra.run.smithi121.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-16T07:32:44.765 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:32:44.765 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2024-09-16T07:32:44.765 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-09-16T07:32:44.766 INFO:teuthology.orchestra.run.smithi121.stdout:Install 6 Packages 2024-09-16T07:32:44.766 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:32:44.766 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 7.0 M 2024-09-16T07:32:44.766 INFO:teuthology.orchestra.run.smithi121.stdout:Installed size: 33 M 2024-09-16T07:32:44.766 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading Packages: 2024-09-16T07:32:44.905 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:02:04 ago on Mon 16 Sep 2024 07:30:40 AM UTC. 2024-09-16T07:32:45.040 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-16T07:32:45.041 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T07:32:45.041 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repo Size 2024-09-16T07:32:45.041 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T07:32:45.041 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-09-16T07:32:45.041 INFO:teuthology.orchestra.run.smithi172.stdout: librados-devel x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 125 k 2024-09-16T07:32:45.041 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:32:45.041 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-09-16T07:32:45.042 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T07:32:45.042 INFO:teuthology.orchestra.run.smithi172.stdout:Install 1 Package 2024-09-16T07:32:45.042 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:32:45.042 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 125 k 2024-09-16T07:32:45.042 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 445 k 2024-09-16T07:32:45.042 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-09-16T07:32:45.234 INFO:teuthology.orchestra.run.smithi172.stdout:librados-devel-19.3.0-4879.g81fedcb3.el9.x86_64 651 kB/s | 125 kB 00:00 2024-09-16T07:32:45.235 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:32:45.235 INFO:teuthology.orchestra.run.smithi172.stdout:Total 645 kB/s | 125 kB 00:00 2024-09-16T07:32:45.235 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-09-16T07:32:45.240 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-09-16T07:32:45.240 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-09-16T07:32:45.299 INFO:teuthology.orchestra.run.smithi121.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.2 MB/s | 248 kB 00:00 2024-09-16T07:32:45.310 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-09-16T07:32:45.310 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-09-16T07:32:45.316 INFO:teuthology.orchestra.run.smithi121.stdout:(2/6): ceph-mgr-cephadm-19.3.0-4879.g81fedcb3.e 721 kB/s | 154 kB 00:00 2024-09-16T07:32:45.366 INFO:teuthology.orchestra.run.smithi121.stdout:(3/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 8.0 MB/s | 548 kB 00:00 2024-09-16T07:32:45.391 INFO:teuthology.orchestra.run.smithi121.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 768 kB/s | 58 kB 00:00 2024-09-16T07:32:45.417 INFO:teuthology.orchestra.run.smithi121.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.5 MB/s | 74 kB 00:00 2024-09-16T07:32:45.478 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-09-16T07:32:45.542 INFO:teuthology.orchestra.run.smithi121.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 14 MB/s | 6.0 MB 00:00 2024-09-16T07:32:45.544 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:32:45.545 INFO:teuthology.orchestra.run.smithi121.stdout:Total 9.0 MB/s | 7.0 MB 00:00 2024-09-16T07:32:45.566 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:32:45.616 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2024-09-16T07:32:45.627 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction check succeeded. 2024-09-16T07:32:45.627 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2024-09-16T07:32:45.727 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded. 2024-09-16T07:32:45.728 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2024-09-16T07:32:46.030 INFO:teuthology.orchestra.run.smithi121.stdout: Preparing : 1/1 2024-09-16T07:32:46.049 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:32:46.211 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-16T07:32:46.252 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-16T07:32:46.303 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:32:46.303 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:32:46.303 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-09-16T07:32:46.303 INFO:teuthology.orchestra.run.smithi172.stdout: librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:32:46.304 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:32:46.304 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-16T07:32:46.544 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install libcephfs2 2024-09-16T07:32:46.793 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-16T07:32:46.889 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-16T07:32:46.957 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-16T07:32:46.981 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 6/6 2024-09-16T07:32:47.126 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:02:07 ago on Mon 16 Sep 2024 07:30:40 AM UTC. 2024-09-16T07:32:47.219 INFO:teuthology.orchestra.run.smithi172.stdout:Package libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T07:32:47.264 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-16T07:32:47.265 INFO:teuthology.orchestra.run.smithi172.stdout:Nothing to do. 2024-09-16T07:32:47.265 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-16T07:32:47.352 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install libcephfs-devel 2024-09-16T07:32:47.810 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 6/6 2024-09-16T07:32:47.810 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/6 2024-09-16T07:32:47.810 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-16T07:32:47.811 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-16T07:32:47.811 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-16T07:32:47.811 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-16T07:32:47.922 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:02:07 ago on Mon 16 Sep 2024 07:30:40 AM UTC. 2024-09-16T07:32:48.057 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-16T07:32:48.057 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T07:32:48.058 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repo Size 2024-09-16T07:32:48.058 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T07:32:48.058 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-09-16T07:32:48.058 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs-devel x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 32 k 2024-09-16T07:32:48.058 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:32:48.058 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-09-16T07:32:48.058 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T07:32:48.058 INFO:teuthology.orchestra.run.smithi172.stdout:Install 1 Package 2024-09-16T07:32:48.058 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:32:48.058 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 32 k 2024-09-16T07:32:48.058 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 142 k 2024-09-16T07:32:48.059 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-09-16T07:32:48.078 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-16T07:32:48.078 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:32:48.078 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2024-09-16T07:32:48.078 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T07:32:48.078 INFO:teuthology.orchestra.run.smithi121.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-16T07:32:48.078 INFO:teuthology.orchestra.run.smithi121.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-16T07:32:48.078 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-16T07:32:48.078 INFO:teuthology.orchestra.run.smithi121.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-16T07:32:48.078 INFO:teuthology.orchestra.run.smithi121.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-16T07:32:48.079 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:32:48.079 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2024-09-16T07:32:48.212 INFO:teuthology.orchestra.run.smithi172.stdout:libcephfs-devel-19.3.0-4879.g81fedcb3.el9.x86_6 206 kB/s | 32 kB 00:00 2024-09-16T07:32:48.213 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:32:48.213 INFO:teuthology.orchestra.run.smithi172.stdout:Total 204 kB/s | 32 kB 00:00 2024-09-16T07:32:48.213 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-09-16T07:32:48.217 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-09-16T07:32:48.217 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-09-16T07:32:48.238 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-09-16T07:32:48.239 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-09-16T07:32:48.333 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-09-16T07:32:48.340 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install ceph-fuse 2024-09-16T07:32:48.452 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:32:48.857 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:32:48.906 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:02:06 ago on Mon 16 Sep 2024 07:30:42 AM UTC. 2024-09-16T07:32:49.041 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2024-09-16T07:32:49.041 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-09-16T07:32:49.041 INFO:teuthology.orchestra.run.smithi121.stdout: Package Arch Version Repository Size 2024-09-16T07:32:49.041 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-09-16T07:32:49.041 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2024-09-16T07:32:49.042 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-fuse x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 884 k 2024-09-16T07:32:49.042 INFO:teuthology.orchestra.run.smithi121.stdout:Installing dependencies: 2024-09-16T07:32:49.042 INFO:teuthology.orchestra.run.smithi121.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-16T07:32:49.042 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:32:49.042 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2024-09-16T07:32:49.042 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-09-16T07:32:49.042 INFO:teuthology.orchestra.run.smithi121.stdout:Install 2 Packages 2024-09-16T07:32:49.042 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:32:49.043 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 964 k 2024-09-16T07:32:49.043 INFO:teuthology.orchestra.run.smithi121.stdout:Installed size: 4.1 M 2024-09-16T07:32:49.043 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading Packages: 2024-09-16T07:32:49.085 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:32:49.085 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:32:49.085 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-09-16T07:32:49.085 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:32:49.085 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:32:49.086 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-16T07:32:49.253 INFO:teuthology.orchestra.run.smithi121.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 423 kB/s | 80 kB 00:00 2024-09-16T07:32:49.267 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install librados2 2024-09-16T07:32:49.311 INFO:teuthology.orchestra.run.smithi121.stdout:(2/2): ceph-fuse-19.3.0-4879.g81fedcb3.el9.x86_ 3.5 MB/s | 884 kB 00:00 2024-09-16T07:32:49.311 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:32:49.312 INFO:teuthology.orchestra.run.smithi121.stdout:Total 3.5 MB/s | 964 kB 00:00 2024-09-16T07:32:49.323 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2024-09-16T07:32:49.347 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction check succeeded. 2024-09-16T07:32:49.347 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2024-09-16T07:32:49.429 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded. 2024-09-16T07:32:49.429 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2024-09-16T07:32:49.616 INFO:teuthology.orchestra.run.smithi121.stdout: Preparing : 1/1 2024-09-16T07:32:49.764 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-16T07:32:49.830 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:02:09 ago on Mon 16 Sep 2024 07:30:40 AM UTC. 2024-09-16T07:32:49.835 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/2 2024-09-16T07:32:49.921 INFO:teuthology.orchestra.run.smithi172.stdout:Package librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T07:32:49.965 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-16T07:32:49.966 INFO:teuthology.orchestra.run.smithi172.stdout:Nothing to do. 2024-09-16T07:32:49.966 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-16T07:32:50.035 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install librbd1 2024-09-16T07:32:50.523 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/2 2024-09-16T07:32:50.524 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/2 2024-09-16T07:32:50.601 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:02:10 ago on Mon 16 Sep 2024 07:30:40 AM UTC. 2024-09-16T07:32:50.692 INFO:teuthology.orchestra.run.smithi172.stdout:Package librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T07:32:50.735 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-16T07:32:50.736 INFO:teuthology.orchestra.run.smithi172.stdout:Nothing to do. 2024-09-16T07:32:50.736 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-16T07:32:50.802 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install python3-rados 2024-09-16T07:32:50.809 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-16T07:32:50.809 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:32:50.809 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2024-09-16T07:32:50.809 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-16T07:32:50.809 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:32:50.809 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2024-09-16T07:32:51.091 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install ceph-volume 2024-09-16T07:32:51.370 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:02:11 ago on Mon 16 Sep 2024 07:30:40 AM UTC. 2024-09-16T07:32:51.461 INFO:teuthology.orchestra.run.smithi172.stdout:Package python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T07:32:51.505 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-16T07:32:51.507 INFO:teuthology.orchestra.run.smithi172.stdout:Nothing to do. 2024-09-16T07:32:51.507 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-16T07:32:51.585 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install python3-rgw 2024-09-16T07:32:51.661 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:02:09 ago on Mon 16 Sep 2024 07:30:42 AM UTC. 2024-09-16T07:32:51.797 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2024-09-16T07:32:51.797 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-09-16T07:32:51.797 INFO:teuthology.orchestra.run.smithi121.stdout: Package Arch Version Repository Size 2024-09-16T07:32:51.797 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-09-16T07:32:51.797 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2024-09-16T07:32:51.797 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-volume noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 285 k 2024-09-16T07:32:51.797 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:32:51.797 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2024-09-16T07:32:51.797 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-09-16T07:32:51.797 INFO:teuthology.orchestra.run.smithi121.stdout:Install 1 Package 2024-09-16T07:32:51.798 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:32:51.798 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 285 k 2024-09-16T07:32:51.798 INFO:teuthology.orchestra.run.smithi121.stdout:Installed size: 1.3 M 2024-09-16T07:32:51.798 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading Packages: 2024-09-16T07:32:52.032 INFO:teuthology.orchestra.run.smithi121.stdout:ceph-volume-19.3.0-4879.g81fedcb3.el9.noarch.rp 1.2 MB/s | 285 kB 00:00 2024-09-16T07:32:52.033 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:32:52.033 INFO:teuthology.orchestra.run.smithi121.stdout:Total 1.2 MB/s | 285 kB 00:00 2024-09-16T07:32:52.033 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2024-09-16T07:32:52.042 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction check succeeded. 2024-09-16T07:32:52.042 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2024-09-16T07:32:52.070 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded. 2024-09-16T07:32:52.070 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2024-09-16T07:32:52.154 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:02:12 ago on Mon 16 Sep 2024 07:30:40 AM UTC. 2024-09-16T07:32:52.246 INFO:teuthology.orchestra.run.smithi172.stdout:Package python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T07:32:52.290 INFO:teuthology.orchestra.run.smithi121.stdout: Preparing : 1/1 2024-09-16T07:32:52.291 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-16T07:32:52.292 INFO:teuthology.orchestra.run.smithi172.stdout:Nothing to do. 2024-09-16T07:32:52.292 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-16T07:32:52.351 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T07:32:52.367 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T07:32:52.367 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T07:32:52.367 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-16T07:32:52.367 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:32:52.371 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install python3-cephfs 2024-09-16T07:32:52.943 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:02:12 ago on Mon 16 Sep 2024 07:30:40 AM UTC. 2024-09-16T07:32:53.033 INFO:teuthology.orchestra.run.smithi172.stdout:Package python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T07:32:53.077 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-16T07:32:53.078 INFO:teuthology.orchestra.run.smithi172.stdout:Nothing to do. 2024-09-16T07:32:53.078 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-16T07:32:53.151 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install python3-rbd 2024-09-16T07:32:53.361 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T07:32:53.362 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:32:53.362 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2024-09-16T07:32:53.362 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T07:32:53.362 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:32:53.362 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2024-09-16T07:32:53.669 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install librados-devel 2024-09-16T07:32:53.724 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:02:13 ago on Mon 16 Sep 2024 07:30:40 AM UTC. 2024-09-16T07:32:53.815 INFO:teuthology.orchestra.run.smithi172.stdout:Package python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T07:32:53.860 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-16T07:32:53.861 INFO:teuthology.orchestra.run.smithi172.stdout:Nothing to do. 2024-09-16T07:32:53.861 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-16T07:32:53.934 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install rbd-fuse 2024-09-16T07:32:54.247 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:02:12 ago on Mon 16 Sep 2024 07:30:42 AM UTC. 2024-09-16T07:32:54.385 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2024-09-16T07:32:54.386 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-09-16T07:32:54.386 INFO:teuthology.orchestra.run.smithi121.stdout: Package Arch Version Repo Size 2024-09-16T07:32:54.386 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-09-16T07:32:54.386 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2024-09-16T07:32:54.386 INFO:teuthology.orchestra.run.smithi121.stdout: librados-devel x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 125 k 2024-09-16T07:32:54.386 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:32:54.386 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2024-09-16T07:32:54.386 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-09-16T07:32:54.386 INFO:teuthology.orchestra.run.smithi121.stdout:Install 1 Package 2024-09-16T07:32:54.387 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:32:54.387 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 125 k 2024-09-16T07:32:54.387 INFO:teuthology.orchestra.run.smithi121.stdout:Installed size: 445 k 2024-09-16T07:32:54.387 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading Packages: 2024-09-16T07:32:54.499 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:02:14 ago on Mon 16 Sep 2024 07:30:40 AM UTC. 2024-09-16T07:32:54.579 INFO:teuthology.orchestra.run.smithi121.stdout:librados-devel-19.3.0-4879.g81fedcb3.el9.x86_64 650 kB/s | 125 kB 00:00 2024-09-16T07:32:54.580 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:32:54.580 INFO:teuthology.orchestra.run.smithi121.stdout:Total 645 kB/s | 125 kB 00:00 2024-09-16T07:32:54.580 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2024-09-16T07:32:54.585 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction check succeeded. 2024-09-16T07:32:54.585 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2024-09-16T07:32:54.634 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-16T07:32:54.635 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T07:32:54.635 INFO:teuthology.orchestra.run.smithi172.stdout: Package Architecture Version Repository Size 2024-09-16T07:32:54.635 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T07:32:54.635 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-09-16T07:32:54.635 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-fuse x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 91 k 2024-09-16T07:32:54.635 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:32:54.635 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-09-16T07:32:54.636 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T07:32:54.636 INFO:teuthology.orchestra.run.smithi172.stdout:Install 1 Package 2024-09-16T07:32:54.636 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:32:54.636 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 91 k 2024-09-16T07:32:54.636 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 321 k 2024-09-16T07:32:54.636 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-09-16T07:32:54.649 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded. 2024-09-16T07:32:54.649 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2024-09-16T07:32:54.807 INFO:teuthology.orchestra.run.smithi121.stdout: Preparing : 1/1 2024-09-16T07:32:54.849 INFO:teuthology.orchestra.run.smithi172.stdout:rbd-fuse-19.3.0-4879.g81fedcb3.el9.x86_64.rpm 427 kB/s | 91 kB 00:00 2024-09-16T07:32:54.849 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:32:54.850 INFO:teuthology.orchestra.run.smithi172.stdout:Total 425 kB/s | 91 kB 00:00 2024-09-16T07:32:54.850 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-09-16T07:32:54.858 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-09-16T07:32:54.859 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-09-16T07:32:54.918 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:32:54.923 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-09-16T07:32:54.923 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-09-16T07:32:55.072 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-09-16T07:32:55.172 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:32:55.427 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:32:55.561 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:32:55.679 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:32:55.679 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:32:55.679 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2024-09-16T07:32:55.679 INFO:teuthology.orchestra.run.smithi121.stdout: librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:32:55.679 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:32:55.679 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2024-09-16T07:32:55.816 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:32:55.816 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:32:55.817 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-09-16T07:32:55.817 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:32:55.817 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:32:55.817 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-16T07:32:55.904 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install libcephfs2 2024-09-16T07:32:56.152 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install rbd-mirror 2024-09-16T07:32:56.487 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:02:14 ago on Mon 16 Sep 2024 07:30:42 AM UTC. 2024-09-16T07:32:56.582 INFO:teuthology.orchestra.run.smithi121.stdout:Package libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T07:32:56.625 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2024-09-16T07:32:56.626 INFO:teuthology.orchestra.run.smithi121.stdout:Nothing to do. 2024-09-16T07:32:56.626 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2024-09-16T07:32:56.684 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install libcephfs-devel 2024-09-16T07:32:56.730 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:02:16 ago on Mon 16 Sep 2024 07:30:40 AM UTC. 2024-09-16T07:32:56.868 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-16T07:32:56.868 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T07:32:56.868 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repo Size 2024-09-16T07:32:56.869 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T07:32:56.869 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-09-16T07:32:56.869 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-mirror x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 3.5 M 2024-09-16T07:32:56.869 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:32:56.869 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-09-16T07:32:56.869 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T07:32:56.869 INFO:teuthology.orchestra.run.smithi172.stdout:Install 1 Package 2024-09-16T07:32:56.869 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:32:56.869 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 3.5 M 2024-09-16T07:32:56.869 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 30 M 2024-09-16T07:32:56.869 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-09-16T07:32:57.227 INFO:teuthology.orchestra.run.smithi172.stdout:rbd-mirror-19.3.0-4879.g81fedcb3.el9.x86_64.rpm 9.8 MB/s | 3.5 MB 00:00 2024-09-16T07:32:57.228 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:32:57.228 INFO:teuthology.orchestra.run.smithi172.stdout:Total 9.8 MB/s | 3.5 MB 00:00 2024-09-16T07:32:57.229 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-09-16T07:32:57.239 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-09-16T07:32:57.240 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-09-16T07:32:57.254 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:02:15 ago on Mon 16 Sep 2024 07:30:42 AM UTC. 2024-09-16T07:32:57.322 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-09-16T07:32:57.323 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-09-16T07:32:57.390 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2024-09-16T07:32:57.390 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-09-16T07:32:57.390 INFO:teuthology.orchestra.run.smithi121.stdout: Package Arch Version Repo Size 2024-09-16T07:32:57.391 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-09-16T07:32:57.391 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2024-09-16T07:32:57.391 INFO:teuthology.orchestra.run.smithi121.stdout: libcephfs-devel x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 32 k 2024-09-16T07:32:57.391 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:32:57.391 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2024-09-16T07:32:57.391 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-09-16T07:32:57.391 INFO:teuthology.orchestra.run.smithi121.stdout:Install 1 Package 2024-09-16T07:32:57.391 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:32:57.391 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 32 k 2024-09-16T07:32:57.391 INFO:teuthology.orchestra.run.smithi121.stdout:Installed size: 142 k 2024-09-16T07:32:57.391 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading Packages: 2024-09-16T07:32:57.541 INFO:teuthology.orchestra.run.smithi121.stdout:libcephfs-devel-19.3.0-4879.g81fedcb3.el9.x86_6 212 kB/s | 32 kB 00:00 2024-09-16T07:32:57.542 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:32:57.542 INFO:teuthology.orchestra.run.smithi121.stdout:Total 210 kB/s | 32 kB 00:00 2024-09-16T07:32:57.542 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2024-09-16T07:32:57.545 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction check succeeded. 2024-09-16T07:32:57.545 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2024-09-16T07:32:57.565 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded. 2024-09-16T07:32:57.565 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2024-09-16T07:32:57.654 INFO:teuthology.orchestra.run.smithi121.stdout: Preparing : 1/1 2024-09-16T07:32:57.771 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:32:57.909 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-09-16T07:32:57.962 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:32:57.986 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:32:57.986 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T07:32:57.987 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-16T07:32:57.987 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T07:32:57.987 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T07:32:57.987 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:32:58.148 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:32:58.385 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:32:58.386 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:32:58.386 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2024-09-16T07:32:58.386 INFO:teuthology.orchestra.run.smithi121.stdout: libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:32:58.386 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:32:58.386 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2024-09-16T07:32:58.566 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install librados2 2024-09-16T07:32:59.126 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:02:17 ago on Mon 16 Sep 2024 07:30:42 AM UTC. 2024-09-16T07:32:59.217 INFO:teuthology.orchestra.run.smithi121.stdout:Package librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T07:32:59.234 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:32:59.234 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:32:59.234 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-09-16T07:32:59.234 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:32:59.234 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:32:59.234 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-16T07:32:59.260 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2024-09-16T07:32:59.261 INFO:teuthology.orchestra.run.smithi121.stdout:Nothing to do. 2024-09-16T07:32:59.261 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2024-09-16T07:32:59.326 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install librbd1 2024-09-16T07:32:59.519 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install rbd-nbd 2024-09-16T07:32:59.893 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:02:17 ago on Mon 16 Sep 2024 07:30:42 AM UTC. 2024-09-16T07:32:59.982 INFO:teuthology.orchestra.run.smithi121.stdout:Package librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T07:33:00.025 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2024-09-16T07:33:00.026 INFO:teuthology.orchestra.run.smithi121.stdout:Nothing to do. 2024-09-16T07:33:00.026 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2024-09-16T07:33:00.092 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install python3-rados 2024-09-16T07:33:00.103 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:02:20 ago on Mon 16 Sep 2024 07:30:40 AM UTC. 2024-09-16T07:33:00.238 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-16T07:33:00.238 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T07:33:00.238 INFO:teuthology.orchestra.run.smithi172.stdout: Package Architecture Version Repository Size 2024-09-16T07:33:00.239 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T07:33:00.239 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-09-16T07:33:00.239 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-nbd x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 177 k 2024-09-16T07:33:00.239 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:33:00.239 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-09-16T07:33:00.239 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-16T07:33:00.239 INFO:teuthology.orchestra.run.smithi172.stdout:Install 1 Package 2024-09-16T07:33:00.239 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:33:00.239 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 177 k 2024-09-16T07:33:00.239 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 685 k 2024-09-16T07:33:00.239 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-09-16T07:33:00.447 INFO:teuthology.orchestra.run.smithi172.stdout:rbd-nbd-19.3.0-4879.g81fedcb3.el9.x86_64.rpm 851 kB/s | 177 kB 00:00 2024-09-16T07:33:00.448 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:33:00.448 INFO:teuthology.orchestra.run.smithi172.stdout:Total 845 kB/s | 177 kB 00:00 2024-09-16T07:33:00.448 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-09-16T07:33:00.457 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-09-16T07:33:00.458 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-09-16T07:33:00.527 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-09-16T07:33:00.527 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-09-16T07:33:00.655 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:02:18 ago on Mon 16 Sep 2024 07:30:42 AM UTC. 2024-09-16T07:33:00.704 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-09-16T07:33:00.744 INFO:teuthology.orchestra.run.smithi121.stdout:Package python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T07:33:00.788 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2024-09-16T07:33:00.788 INFO:teuthology.orchestra.run.smithi121.stdout:Nothing to do. 2024-09-16T07:33:00.788 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2024-09-16T07:33:00.803 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:33:00.851 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install python3-rgw 2024-09-16T07:33:01.237 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:33:01.414 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:02:19 ago on Mon 16 Sep 2024 07:30:42 AM UTC. 2024-09-16T07:33:01.505 INFO:teuthology.orchestra.run.smithi121.stdout:Package python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T07:33:01.506 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:33:01.506 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:33:01.506 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-09-16T07:33:01.506 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:33:01.506 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:33:01.506 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-16T07:33:01.549 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2024-09-16T07:33:01.550 INFO:teuthology.orchestra.run.smithi121.stdout:Nothing to do. 2024-09-16T07:33:01.550 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2024-09-16T07:33:01.615 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install python3-cephfs 2024-09-16T07:33:01.751 DEBUG:teuthology.parallel:result is None 2024-09-16T07:33:02.184 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:02:20 ago on Mon 16 Sep 2024 07:30:42 AM UTC. 2024-09-16T07:33:02.275 INFO:teuthology.orchestra.run.smithi121.stdout:Package python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T07:33:02.320 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2024-09-16T07:33:02.321 INFO:teuthology.orchestra.run.smithi121.stdout:Nothing to do. 2024-09-16T07:33:02.321 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2024-09-16T07:33:02.390 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install python3-rbd 2024-09-16T07:33:02.955 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:02:20 ago on Mon 16 Sep 2024 07:30:42 AM UTC. 2024-09-16T07:33:03.046 INFO:teuthology.orchestra.run.smithi121.stdout:Package python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T07:33:03.089 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2024-09-16T07:33:03.090 INFO:teuthology.orchestra.run.smithi121.stdout:Nothing to do. 2024-09-16T07:33:03.090 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2024-09-16T07:33:03.146 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install rbd-fuse 2024-09-16T07:33:03.712 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:02:21 ago on Mon 16 Sep 2024 07:30:42 AM UTC. 2024-09-16T07:33:03.847 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2024-09-16T07:33:03.847 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-09-16T07:33:03.847 INFO:teuthology.orchestra.run.smithi121.stdout: Package Architecture Version Repository Size 2024-09-16T07:33:03.847 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-09-16T07:33:03.848 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2024-09-16T07:33:03.848 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-fuse x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 91 k 2024-09-16T07:33:03.848 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:33:03.848 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2024-09-16T07:33:03.848 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-09-16T07:33:03.848 INFO:teuthology.orchestra.run.smithi121.stdout:Install 1 Package 2024-09-16T07:33:03.848 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:33:03.848 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 91 k 2024-09-16T07:33:03.849 INFO:teuthology.orchestra.run.smithi121.stdout:Installed size: 321 k 2024-09-16T07:33:03.849 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading Packages: 2024-09-16T07:33:04.043 INFO:teuthology.orchestra.run.smithi121.stdout:rbd-fuse-19.3.0-4879.g81fedcb3.el9.x86_64.rpm 467 kB/s | 91 kB 00:00 2024-09-16T07:33:04.044 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:33:04.044 INFO:teuthology.orchestra.run.smithi121.stdout:Total 464 kB/s | 91 kB 00:00 2024-09-16T07:33:04.044 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2024-09-16T07:33:04.053 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction check succeeded. 2024-09-16T07:33:04.053 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2024-09-16T07:33:04.119 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded. 2024-09-16T07:33:04.119 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2024-09-16T07:33:04.267 INFO:teuthology.orchestra.run.smithi121.stdout: Preparing : 1/1 2024-09-16T07:33:04.366 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:33:04.776 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:33:05.041 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:33:05.042 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:33:05.042 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2024-09-16T07:33:05.042 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:33:05.042 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:33:05.042 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2024-09-16T07:33:05.306 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install rbd-mirror 2024-09-16T07:33:05.899 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:02:23 ago on Mon 16 Sep 2024 07:30:42 AM UTC. 2024-09-16T07:33:06.041 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2024-09-16T07:33:06.041 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-09-16T07:33:06.041 INFO:teuthology.orchestra.run.smithi121.stdout: Package Arch Version Repo Size 2024-09-16T07:33:06.042 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-09-16T07:33:06.042 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2024-09-16T07:33:06.042 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-mirror x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 3.5 M 2024-09-16T07:33:06.042 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:33:06.042 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2024-09-16T07:33:06.042 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-09-16T07:33:06.042 INFO:teuthology.orchestra.run.smithi121.stdout:Install 1 Package 2024-09-16T07:33:06.042 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:33:06.042 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 3.5 M 2024-09-16T07:33:06.042 INFO:teuthology.orchestra.run.smithi121.stdout:Installed size: 30 M 2024-09-16T07:33:06.042 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading Packages: 2024-09-16T07:33:06.373 INFO:teuthology.orchestra.run.smithi121.stdout:rbd-mirror-19.3.0-4879.g81fedcb3.el9.x86_64.rpm 11 MB/s | 3.5 MB 00:00 2024-09-16T07:33:06.373 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:33:06.374 INFO:teuthology.orchestra.run.smithi121.stdout:Total 11 MB/s | 3.5 MB 00:00 2024-09-16T07:33:06.374 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2024-09-16T07:33:06.385 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction check succeeded. 2024-09-16T07:33:06.386 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2024-09-16T07:33:06.472 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded. 2024-09-16T07:33:06.473 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2024-09-16T07:33:07.080 INFO:teuthology.orchestra.run.smithi121.stdout: Preparing : 1/1 2024-09-16T07:33:07.149 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:33:07.176 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:33:07.177 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T07:33:07.177 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-16T07:33:07.177 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T07:33:07.177 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T07:33:07.177 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:33:08.398 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:33:08.399 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:33:08.399 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2024-09-16T07:33:08.399 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:33:08.399 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:33:08.399 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2024-09-16T07:33:08.637 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install rbd-nbd 2024-09-16T07:33:09.225 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:02:27 ago on Mon 16 Sep 2024 07:30:42 AM UTC. 2024-09-16T07:33:09.356 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2024-09-16T07:33:09.356 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-09-16T07:33:09.356 INFO:teuthology.orchestra.run.smithi121.stdout: Package Architecture Version Repository Size 2024-09-16T07:33:09.357 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-09-16T07:33:09.357 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2024-09-16T07:33:09.357 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-nbd x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 177 k 2024-09-16T07:33:09.357 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:33:09.357 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2024-09-16T07:33:09.357 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-09-16T07:33:09.357 INFO:teuthology.orchestra.run.smithi121.stdout:Install 1 Package 2024-09-16T07:33:09.357 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:33:09.357 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 177 k 2024-09-16T07:33:09.357 INFO:teuthology.orchestra.run.smithi121.stdout:Installed size: 685 k 2024-09-16T07:33:09.357 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading Packages: 2024-09-16T07:33:09.539 INFO:teuthology.orchestra.run.smithi121.stdout:rbd-nbd-19.3.0-4879.g81fedcb3.el9.x86_64.rpm 974 kB/s | 177 kB 00:00 2024-09-16T07:33:09.540 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:33:09.540 INFO:teuthology.orchestra.run.smithi121.stdout:Total 965 kB/s | 177 kB 00:00 2024-09-16T07:33:09.540 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2024-09-16T07:33:09.549 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction check succeeded. 2024-09-16T07:33:09.549 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2024-09-16T07:33:09.617 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded. 2024-09-16T07:33:09.617 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2024-09-16T07:33:09.791 INFO:teuthology.orchestra.run.smithi121.stdout: Preparing : 1/1 2024-09-16T07:33:09.891 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:33:10.332 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:33:10.575 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:33:10.575 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:33:10.575 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2024-09-16T07:33:10.575 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:33:10.575 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:33:10.575 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2024-09-16T07:33:10.821 DEBUG:teuthology.parallel:result is None 2024-09-16T07:33:10.822 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=81fedcb3b484c843d22ffbc8d179cb567b7083b5 2024-09-16T07:33:10.971 DEBUG:teuthology.orchestra.run.smithi121:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-16T07:33:10.992 INFO:teuthology.orchestra.run.smithi121.stdout:19.3.0-4879.g81fedcb3.el9 2024-09-16T07:33:10.993 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4879.g81fedcb3.el9 2024-09-16T07:33:10.993 INFO:teuthology.task.install:The correct ceph version 19.3.0-4879.g81fedcb3 is installed. 2024-09-16T07:33:10.995 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=81fedcb3b484c843d22ffbc8d179cb567b7083b5 2024-09-16T07:33:11.135 DEBUG:teuthology.orchestra.run.smithi172:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-16T07:33:11.161 INFO:teuthology.orchestra.run.smithi172.stdout:19.3.0-4879.g81fedcb3.el9 2024-09-16T07:33:11.162 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4879.g81fedcb3.el9 2024-09-16T07:33:11.162 INFO:teuthology.task.install:The correct ceph version 19.3.0-4879.g81fedcb3 is installed. 2024-09-16T07:33:11.163 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-16T07:33:11.164 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-16T07:33:11.164 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-16T07:33:11.189 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-16T07:33:11.189 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-16T07:33:11.234 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-16T07:33:11.235 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-16T07:33:11.235 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/usr/bin/daemon-helper 2024-09-16T07:33:11.259 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-16T07:33:11.324 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-16T07:33:11.324 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/daemon-helper 2024-09-16T07:33:11.352 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-16T07:33:11.421 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-16T07:33:11.422 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-16T07:33:11.422 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-16T07:33:11.447 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-16T07:33:11.512 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-16T07:33:11.512 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-16T07:33:11.540 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-16T07:33:11.607 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-16T07:33:11.607 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-16T07:33:11.608 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/usr/bin/stdin-killer 2024-09-16T07:33:11.632 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-16T07:33:11.696 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-16T07:33:11.696 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/stdin-killer 2024-09-16T07:33:11.723 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-16T07:33:11.790 INFO:teuthology.run_tasks:Running task ceph... 2024-09-16T07:33:11.879 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-16T07:33:11.880 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 777 /var/log/ceph 2024-09-16T07:33:11.882 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 777 /var/log/ceph 2024-09-16T07:33:11.909 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-16T07:33:11.909 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-16T07:33:11.947 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-16T07:33:11.975 INFO:tasks.ceph:Creating extra log directories... 2024-09-16T07:33:11.975 DEBUG:teuthology.orchestra.run.smithi121:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-16T07:33:12.012 DEBUG:teuthology.orchestra.run.smithi172:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-16T07:33:12.049 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-16T07:33:12.050 INFO:tasks.ceph:config {'conf': {'mon': {'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'osd': {'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'client': {'debug ms': 1}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr stats period': 30}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-16T07:33:12.050 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/matan-2024-09-16_07:15:55-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7906859', 'branch': 'wip-matanb-crimson-testing-59543', 'description': 'crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore tasks/rados_api_tests}', 'email': None, 'first_in_suite': False, 'job_id': '7906859', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'matan-2024-09-16_07:15:55-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-matanb-crimson-testing-59543'}, 'ceph': {'conf': {'client': {'debug ms': 1}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr stats period': 30}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'flavor': 'crimson', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'crimson', 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'workunit': {'branch': 'main', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': '0325fd3c11a225c0fd9eb38fab88aad1370ad779'}}, 'owner': 'scheduled_matan@teuthology', 'priority': 60, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'], ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 6651, 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5', 'sleep_before_teardown': 0, 'suite': 'crimson-rados', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '0325fd3c11a225c0fd9eb38fab88aad1370ad779', 'targets': {'smithi121.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOzX5F/GByLb6FRiF4XYzbPpgSLgVSjSvYKqja56Pbr273g4i3/6XrHYQeSgZd+DoGgwz2H2AiSnT1Xnl3ClC48=', 'smithi172.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKDRtyWet5Ple/wpGFipoPZqSr/3zGFdvxZZl5uSlLgGN6QNrXgInCV2oWNFDQdDKBINGCGzsrfQSRRVo/571hw='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'mon': {'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'osd': {'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'client': {'debug ms': 1}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr stats period': 30}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'flavor': 'crimson', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5', 'cluster': 'ceph'}}, {'workunit': {'clients': {'client.0': ['rados/test.sh --crimson', 'rados/test_pool_quota.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-16_07:15:55', 'tube': 'smithi', 'user': 'matan', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-16T07:33:12.050 DEBUG:teuthology.orchestra.run.smithi121:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-16T07:33:12.077 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-16T07:33:12.097 DEBUG:teuthology.orchestra.run.smithi121:> sudo install -d -m0777 -- /var/run/ceph 2024-09-16T07:33:12.134 DEBUG:teuthology.orchestra.run.smithi172:> sudo install -d -m0777 -- /var/run/ceph 2024-09-16T07:33:12.162 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-16T07:33:12.162 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/scratch_devs of=/dev/stdout 2024-09-16T07:33:12.212 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-16T07:33:12.212 DEBUG:teuthology.orchestra.run.smithi121:> stat /dev/vg_nvme/lv_1 2024-09-16T07:33:12.267 INFO:teuthology.orchestra.run.smithi121.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-16T07:33:12.267 INFO:teuthology.orchestra.run.smithi121.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T07:33:12.267 INFO:teuthology.orchestra.run.smithi121.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-16T07:33:12.267 INFO:teuthology.orchestra.run.smithi121.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T07:33:12.267 INFO:teuthology.orchestra.run.smithi121.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T07:33:12.267 INFO:teuthology.orchestra.run.smithi121.stdout:Access: 2024-09-16 07:33:07.434756280 +0000 2024-09-16T07:33:12.268 INFO:teuthology.orchestra.run.smithi121.stdout:Modify: 2024-09-16 07:29:55.647258450 +0000 2024-09-16T07:33:12.268 INFO:teuthology.orchestra.run.smithi121.stdout:Change: 2024-09-16 07:29:55.647258450 +0000 2024-09-16T07:33:12.268 INFO:teuthology.orchestra.run.smithi121.stdout: Birth: 2024-09-16 07:29:55.647258450 +0000 2024-09-16T07:33:12.268 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-16T07:33:12.330 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records in 2024-09-16T07:33:12.330 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records out 2024-09-16T07:33:12.330 INFO:teuthology.orchestra.run.smithi121.stderr:512 bytes copied, 0.000207272 s, 2.5 MB/s 2024-09-16T07:33:12.331 DEBUG:teuthology.orchestra.run.smithi121:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-16T07:33:12.388 DEBUG:teuthology.orchestra.run.smithi121:> stat /dev/vg_nvme/lv_2 2024-09-16T07:33:12.444 INFO:teuthology.orchestra.run.smithi121.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-16T07:33:12.444 INFO:teuthology.orchestra.run.smithi121.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T07:33:12.444 INFO:teuthology.orchestra.run.smithi121.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-16T07:33:12.444 INFO:teuthology.orchestra.run.smithi121.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T07:33:12.445 INFO:teuthology.orchestra.run.smithi121.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T07:33:12.445 INFO:teuthology.orchestra.run.smithi121.stdout:Access: 2024-09-16 07:33:07.434756280 +0000 2024-09-16T07:33:12.445 INFO:teuthology.orchestra.run.smithi121.stdout:Modify: 2024-09-16 07:29:55.982254039 +0000 2024-09-16T07:33:12.445 INFO:teuthology.orchestra.run.smithi121.stdout:Change: 2024-09-16 07:29:55.982254039 +0000 2024-09-16T07:33:12.445 INFO:teuthology.orchestra.run.smithi121.stdout: Birth: 2024-09-16 07:29:55.982254039 +0000 2024-09-16T07:33:12.445 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-16T07:33:12.508 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records in 2024-09-16T07:33:12.509 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records out 2024-09-16T07:33:12.509 INFO:teuthology.orchestra.run.smithi121.stderr:512 bytes copied, 0.000244747 s, 2.1 MB/s 2024-09-16T07:33:12.510 DEBUG:teuthology.orchestra.run.smithi121:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-16T07:33:12.566 DEBUG:teuthology.orchestra.run.smithi121:> stat /dev/vg_nvme/lv_3 2024-09-16T07:33:12.621 INFO:teuthology.orchestra.run.smithi121.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-16T07:33:12.621 INFO:teuthology.orchestra.run.smithi121.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T07:33:12.621 INFO:teuthology.orchestra.run.smithi121.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-16T07:33:12.621 INFO:teuthology.orchestra.run.smithi121.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T07:33:12.621 INFO:teuthology.orchestra.run.smithi121.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T07:33:12.621 INFO:teuthology.orchestra.run.smithi121.stdout:Access: 2024-09-16 07:33:07.434756280 +0000 2024-09-16T07:33:12.621 INFO:teuthology.orchestra.run.smithi121.stdout:Modify: 2024-09-16 07:29:56.300249852 +0000 2024-09-16T07:33:12.621 INFO:teuthology.orchestra.run.smithi121.stdout:Change: 2024-09-16 07:29:56.300249852 +0000 2024-09-16T07:33:12.622 INFO:teuthology.orchestra.run.smithi121.stdout: Birth: 2024-09-16 07:29:56.300249852 +0000 2024-09-16T07:33:12.622 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-16T07:33:12.686 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records in 2024-09-16T07:33:12.686 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records out 2024-09-16T07:33:12.686 INFO:teuthology.orchestra.run.smithi121.stderr:512 bytes copied, 0.000191932 s, 2.7 MB/s 2024-09-16T07:33:12.687 DEBUG:teuthology.orchestra.run.smithi121:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-16T07:33:12.743 DEBUG:teuthology.orchestra.run.smithi121:> stat /dev/vg_nvme/lv_4 2024-09-16T07:33:12.800 INFO:teuthology.orchestra.run.smithi121.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-16T07:33:12.800 INFO:teuthology.orchestra.run.smithi121.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T07:33:12.800 INFO:teuthology.orchestra.run.smithi121.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-16T07:33:12.800 INFO:teuthology.orchestra.run.smithi121.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T07:33:12.800 INFO:teuthology.orchestra.run.smithi121.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T07:33:12.800 INFO:teuthology.orchestra.run.smithi121.stdout:Access: 2024-09-16 07:33:07.435756266 +0000 2024-09-16T07:33:12.800 INFO:teuthology.orchestra.run.smithi121.stdout:Modify: 2024-09-16 07:29:56.606245823 +0000 2024-09-16T07:33:12.800 INFO:teuthology.orchestra.run.smithi121.stdout:Change: 2024-09-16 07:29:56.606245823 +0000 2024-09-16T07:33:12.800 INFO:teuthology.orchestra.run.smithi121.stdout: Birth: 2024-09-16 07:29:56.606245823 +0000 2024-09-16T07:33:12.801 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-16T07:33:12.863 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records in 2024-09-16T07:33:12.863 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records out 2024-09-16T07:33:12.863 INFO:teuthology.orchestra.run.smithi121.stderr:512 bytes copied, 0.000173894 s, 2.9 MB/s 2024-09-16T07:33:12.864 DEBUG:teuthology.orchestra.run.smithi121:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-16T07:33:12.921 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2024-09-16T07:33:12.921 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-16T07:33:12.922 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/scratch_devs of=/dev/stdout 2024-09-16T07:33:12.941 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-16T07:33:12.941 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_1 2024-09-16T07:33:12.999 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-16T07:33:12.999 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T07:33:13.000 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-16T07:33:13.000 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T07:33:13.000 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T07:33:13.000 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-09-16 07:32:58.271402344 +0000 2024-09-16T07:33:13.000 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-09-16 07:29:55.659856205 +0000 2024-09-16T07:33:13.000 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-09-16 07:29:55.659856205 +0000 2024-09-16T07:33:13.000 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2024-09-16 07:29:55.659856205 +0000 2024-09-16T07:33:13.000 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-16T07:33:13.067 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-09-16T07:33:13.067 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-09-16T07:33:13.067 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000245667 s, 2.1 MB/s 2024-09-16T07:33:13.069 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-16T07:33:13.128 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_2 2024-09-16T07:33:13.185 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-16T07:33:13.185 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T07:33:13.185 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-16T07:33:13.185 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T07:33:13.185 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T07:33:13.185 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-09-16 07:32:58.272402320 +0000 2024-09-16T07:33:13.186 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-09-16 07:29:55.996848212 +0000 2024-09-16T07:33:13.186 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-09-16 07:29:55.996848212 +0000 2024-09-16T07:33:13.186 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2024-09-16 07:29:55.996848212 +0000 2024-09-16T07:33:13.186 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-16T07:33:13.250 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-09-16T07:33:13.250 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-09-16T07:33:13.250 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000214792 s, 2.4 MB/s 2024-09-16T07:33:13.252 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-16T07:33:13.309 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_3 2024-09-16T07:33:13.366 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-16T07:33:13.366 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T07:33:13.366 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-16T07:33:13.366 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T07:33:13.366 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T07:33:13.366 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-09-16 07:32:58.272402320 +0000 2024-09-16T07:33:13.366 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-09-16 07:29:56.329840313 +0000 2024-09-16T07:33:13.366 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-09-16 07:29:56.329840313 +0000 2024-09-16T07:33:13.367 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2024-09-16 07:29:56.329840313 +0000 2024-09-16T07:33:13.367 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-16T07:33:13.430 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-09-16T07:33:13.430 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-09-16T07:33:13.430 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000189661 s, 2.7 MB/s 2024-09-16T07:33:13.431 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-16T07:33:13.488 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_4 2024-09-16T07:33:13.544 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-16T07:33:13.544 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T07:33:13.544 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-16T07:33:13.544 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T07:33:13.544 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T07:33:13.545 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-09-16 07:32:58.272402320 +0000 2024-09-16T07:33:13.545 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-09-16 07:29:56.660832462 +0000 2024-09-16T07:33:13.545 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-09-16 07:29:56.660832462 +0000 2024-09-16T07:33:13.545 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2024-09-16 07:29:56.660832462 +0000 2024-09-16T07:33:13.545 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-16T07:33:13.607 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-09-16T07:33:13.607 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-09-16T07:33:13.607 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.0002141 s, 2.4 MB/s 2024-09-16T07:33:13.608 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-16T07:33:13.665 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2024-09-16T07:33:13.665 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi121.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi172.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2024-09-16T07:33:13.665 INFO:tasks.ceph:Generating config... 2024-09-16T07:33:13.667 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2024-09-16T07:33:13.667 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2024-09-16T07:33:13.667 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2024-09-16T07:33:13.667 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2024-09-16T07:33:13.667 INFO:tasks.ceph:[mon] paxos service trim min = 10 2024-09-16T07:33:13.667 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-16T07:33:13.667 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-16T07:33:13.667 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-16T07:33:13.667 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-09-16T07:33:13.667 INFO:tasks.ceph:[mon] osd pool default crimson = True 2024-09-16T07:33:13.668 INFO:tasks.ceph:[osd] debug monc = 20 2024-09-16T07:33:13.668 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-16T07:33:13.668 INFO:tasks.ceph:[osd] bluestore compression algorithm = snappy 2024-09-16T07:33:13.668 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-09-16T07:33:13.668 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-16T07:33:13.668 INFO:tasks.ceph:[osd] bluestore rocksdb cf = False 2024-09-16T07:33:13.668 INFO:tasks.ceph:[osd] crimson alien thread cpu cores = 6-7 2024-09-16T07:33:13.668 INFO:tasks.ceph:[osd] crimson osd obc lru size = 10 2024-09-16T07:33:13.668 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-16T07:33:13.668 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-16T07:33:13.668 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-16T07:33:13.668 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-16T07:33:13.668 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-16T07:33:13.668 INFO:tasks.ceph:[osd] err to stderr = True 2024-09-16T07:33:13.669 INFO:tasks.ceph:[osd] log flush on exit = True 2024-09-16T07:33:13.669 INFO:tasks.ceph:[osd] log to file = False 2024-09-16T07:33:13.669 INFO:tasks.ceph:[osd] log to stderr = True 2024-09-16T07:33:13.669 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-16T07:33:13.669 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-16T07:33:13.669 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-16T07:33:13.669 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-09-16T07:33:13.669 INFO:tasks.ceph:[osd] osd class default list = * 2024-09-16T07:33:13.669 INFO:tasks.ceph:[osd] osd class load list = * 2024-09-16T07:33:13.669 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-16T07:33:13.669 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-16T07:33:13.669 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-16T07:33:13.669 INFO:tasks.ceph:[client] debug ms = 1 2024-09-16T07:33:13.670 INFO:tasks.ceph:[global] enable experimental unrecoverable data corrupting features = crimson 2024-09-16T07:33:13.670 INFO:tasks.ceph:[global] ms client mode = crc 2024-09-16T07:33:13.670 INFO:tasks.ceph:[global] ms cluster mode = crc 2024-09-16T07:33:13.670 INFO:tasks.ceph:[global] ms mon client mode = crc 2024-09-16T07:33:13.670 INFO:tasks.ceph:[global] ms mon cluster mode = crc 2024-09-16T07:33:13.670 INFO:tasks.ceph:[global] ms mon service mode = crc 2024-09-16T07:33:13.670 INFO:tasks.ceph:[global] ms service mode = crc 2024-09-16T07:33:13.670 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-16T07:33:13.670 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-16T07:33:13.670 INFO:tasks.ceph:[mgr] mgr stats period = 30 2024-09-16T07:33:13.670 INFO:tasks.ceph:[osd.0] crimson seastar cpu cores = 0-2 2024-09-16T07:33:13.670 INFO:tasks.ceph:[osd.1] crimson seastar cpu cores = 3-5 2024-09-16T07:33:13.670 INFO:tasks.ceph:[osd.2] crimson seastar cpu cores = 0-2 2024-09-16T07:33:13.670 INFO:tasks.ceph:[osd.3] crimson seastar cpu cores = 3-5 2024-09-16T07:33:13.671 INFO:tasks.ceph:Setting up mon.a... 2024-09-16T07:33:13.671 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-16T07:33:13.728 INFO:teuthology.orchestra.run.smithi121.stdout:creating /etc/ceph/ceph.keyring 2024-09-16T07:33:13.731 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-16T07:33:13.784 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-16T07:33:13.809 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.121')] 2024-09-16T07:33:13.810 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.121', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'mgr stats period': 30}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1}, 'mon.a': {}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}} 2024-09-16T07:33:13.811 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-16T07:33:13.811 DEBUG:teuthology.orchestra.run.smithi121:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-16T07:33:13.864 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.121 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-16T07:33:13.956 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:13.956+0000 7f43a9c51f00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:13.956 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:13.956+0000 7f43a9c51f00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:13.956 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:13.957+0000 7f43a9c51f00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:13.957 INFO:teuthology.orchestra.run.smithi121.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-16T07:33:13.957 INFO:teuthology.orchestra.run.smithi121.stdout:monmaptool: generated fsid 5b0c4070-0374-47d9-9f2a-f525ac27c89c 2024-09-16T07:33:13.957 INFO:teuthology.orchestra.run.smithi121.stdout:setting min_mon_release = quincy 2024-09-16T07:33:13.957 INFO:teuthology.orchestra.run.smithi121.stdout:epoch 0 2024-09-16T07:33:13.957 INFO:teuthology.orchestra.run.smithi121.stdout:fsid 5b0c4070-0374-47d9-9f2a-f525ac27c89c 2024-09-16T07:33:13.957 INFO:teuthology.orchestra.run.smithi121.stdout:last_changed 2024-09-16T07:33:13.958245+0000 2024-09-16T07:33:13.957 INFO:teuthology.orchestra.run.smithi121.stdout:created 2024-09-16T07:33:13.958245+0000 2024-09-16T07:33:13.957 INFO:teuthology.orchestra.run.smithi121.stdout:min_mon_release 17 (quincy) 2024-09-16T07:33:13.957 INFO:teuthology.orchestra.run.smithi121.stdout:election_strategy: 1 2024-09-16T07:33:13.957 INFO:teuthology.orchestra.run.smithi121.stdout:0: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.a 2024-09-16T07:33:13.957 INFO:teuthology.orchestra.run.smithi121.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-09-16T07:33:13.959 DEBUG:teuthology.orchestra.run.smithi121:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-16T07:33:13.973 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 5b0c4070-0374-47d9-9f2a-f525ac27c89c... 2024-09-16T07:33:13.974 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-16T07:33:14.016 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-16T07:33:14.056 INFO:teuthology.orchestra.run.smithi121.stdout:[global] 2024-09-16T07:33:14.056 INFO:teuthology.orchestra.run.smithi121.stdout: chdir = "" 2024-09-16T07:33:14.056 INFO:teuthology.orchestra.run.smithi121.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-16T07:33:14.056 INFO:teuthology.orchestra.run.smithi121.stdout: auth supported = cephx 2024-09-16T07:33:14.056 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:33:14.056 INFO:teuthology.orchestra.run.smithi121.stdout: filestore xattr use omap = true 2024-09-16T07:33:14.056 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:33:14.057 INFO:teuthology.orchestra.run.smithi121.stdout: mon clock drift allowed = 1.000 2024-09-16T07:33:14.057 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:33:14.057 INFO:teuthology.orchestra.run.smithi121.stdout: osd crush chooseleaf type = 0 2024-09-16T07:33:14.057 INFO:teuthology.orchestra.run.smithi121.stdout: auth debug = true 2024-09-16T07:33:14.057 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:33:14.057 INFO:teuthology.orchestra.run.smithi121.stdout: ms die on old message = true 2024-09-16T07:33:14.057 INFO:teuthology.orchestra.run.smithi121.stdout: ms die on bug = true 2024-09-16T07:33:14.057 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:33:14.057 INFO:teuthology.orchestra.run.smithi121.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-16T07:33:14.057 INFO:teuthology.orchestra.run.smithi121.stdout: mon pg warn max object skew = 0 2024-09-16T07:33:14.057 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:33:14.058 INFO:teuthology.orchestra.run.smithi121.stdout: # disable pg_autoscaler by default for new pools 2024-09-16T07:33:14.058 INFO:teuthology.orchestra.run.smithi121.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-16T07:33:14.058 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:33:14.058 INFO:teuthology.orchestra.run.smithi121.stdout: osd pool default size = 2 2024-09-16T07:33:14.058 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:33:14.058 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd allow primary affinity = true 2024-09-16T07:33:14.058 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd allow pg remap = true 2024-09-16T07:33:14.058 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on legacy crush tunables = false 2024-09-16T07:33:14.058 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on crush straw calc version zero = false 2024-09-16T07:33:14.058 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on no sortbitwise = false 2024-09-16T07:33:14.058 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on osd down out interval zero = false 2024-09-16T07:33:14.058 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on too few osds = false 2024-09-16T07:33:14.058 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-16T07:33:14.058 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-16T07:33:14.059 INFO:teuthology.orchestra.run.smithi121.stdout: mon_allow_pool_size_one = true 2024-09-16T07:33:14.059 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:33:14.059 INFO:teuthology.orchestra.run.smithi121.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-16T07:33:14.059 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:33:14.059 INFO:teuthology.orchestra.run.smithi121.stdout: osd default data pool replay window = 5 2024-09-16T07:33:14.059 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:33:14.059 INFO:teuthology.orchestra.run.smithi121.stdout: mon allow pool delete = true 2024-09-16T07:33:14.059 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:33:14.059 INFO:teuthology.orchestra.run.smithi121.stdout: mon cluster log file level = debug 2024-09-16T07:33:14.059 INFO:teuthology.orchestra.run.smithi121.stdout: debug asserts on shutdown = true 2024-09-16T07:33:14.059 INFO:teuthology.orchestra.run.smithi121.stdout: mon health detail to clog = false 2024-09-16T07:33:14.059 INFO:teuthology.orchestra.run.smithi121.stdout: mon host = 172.21.15.121 2024-09-16T07:33:14.059 INFO:teuthology.orchestra.run.smithi121.stdout: enable experimental unrecoverable data corrupting features = crimson 2024-09-16T07:33:14.060 INFO:teuthology.orchestra.run.smithi121.stdout: ms client mode = crc 2024-09-16T07:33:14.060 INFO:teuthology.orchestra.run.smithi121.stdout: ms cluster mode = crc 2024-09-16T07:33:14.060 INFO:teuthology.orchestra.run.smithi121.stdout: ms mon client mode = crc 2024-09-16T07:33:14.060 INFO:teuthology.orchestra.run.smithi121.stdout: ms mon cluster mode = crc 2024-09-16T07:33:14.060 INFO:teuthology.orchestra.run.smithi121.stdout: ms mon service mode = crc 2024-09-16T07:33:14.060 INFO:teuthology.orchestra.run.smithi121.stdout: ms service mode = crc 2024-09-16T07:33:14.060 INFO:teuthology.orchestra.run.smithi121.stdout: fsid = 5b0c4070-0374-47d9-9f2a-f525ac27c89c 2024-09-16T07:33:14.060 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:33:14.060 INFO:teuthology.orchestra.run.smithi121.stdout:[osd] 2024-09-16T07:33:14.060 INFO:teuthology.orchestra.run.smithi121.stdout: osd journal size = 100 2024-09-16T07:33:14.060 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:33:14.060 INFO:teuthology.orchestra.run.smithi121.stdout: osd scrub load threshold = 5.0 2024-09-16T07:33:14.060 INFO:teuthology.orchestra.run.smithi121.stdout: osd scrub max interval = 600 2024-09-16T07:33:14.060 INFO:teuthology.orchestra.run.smithi121.stdout: osd mclock profile = high_recovery_ops 2024-09-16T07:33:14.060 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:33:14.061 INFO:teuthology.orchestra.run.smithi121.stdout: osd recover clone overlap = true 2024-09-16T07:33:14.061 INFO:teuthology.orchestra.run.smithi121.stdout: osd recovery max chunk = 1048576 2024-09-16T07:33:14.061 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:33:14.061 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug shutdown = true 2024-09-16T07:33:14.061 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug op order = true 2024-09-16T07:33:14.061 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug verify stray on activate = true 2024-09-16T07:33:14.061 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug trim objects = true 2024-09-16T07:33:14.061 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:33:14.061 INFO:teuthology.orchestra.run.smithi121.stdout: osd open classes on start = true 2024-09-16T07:33:14.061 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug pg log writeout = true 2024-09-16T07:33:14.061 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:33:14.061 INFO:teuthology.orchestra.run.smithi121.stdout: osd deep scrub update digest min age = 30 2024-09-16T07:33:14.061 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:33:14.062 INFO:teuthology.orchestra.run.smithi121.stdout: osd map max advance = 10 2024-09-16T07:33:14.062 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:33:14.062 INFO:teuthology.orchestra.run.smithi121.stdout: journal zero on create = true 2024-09-16T07:33:14.062 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:33:14.062 INFO:teuthology.orchestra.run.smithi121.stdout: filestore ondisk finisher threads = 3 2024-09-16T07:33:14.062 INFO:teuthology.orchestra.run.smithi121.stdout: filestore apply finisher threads = 3 2024-09-16T07:33:14.062 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:33:14.062 INFO:teuthology.orchestra.run.smithi121.stdout: bdev debug aio = true 2024-09-16T07:33:14.062 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug misdirected ops = true 2024-09-16T07:33:14.062 INFO:teuthology.orchestra.run.smithi121.stdout: debug monc = 20 2024-09-16T07:33:14.062 INFO:teuthology.orchestra.run.smithi121.stdout: bluestore block size = 96636764160 2024-09-16T07:33:14.062 INFO:teuthology.orchestra.run.smithi121.stdout: bluestore compression algorithm = snappy 2024-09-16T07:33:14.062 INFO:teuthology.orchestra.run.smithi121.stdout: bluestore compression mode = aggressive 2024-09-16T07:33:14.062 INFO:teuthology.orchestra.run.smithi121.stdout: bluestore fsck on mount = True 2024-09-16T07:33:14.063 INFO:teuthology.orchestra.run.smithi121.stdout: bluestore rocksdb cf = False 2024-09-16T07:33:14.063 INFO:teuthology.orchestra.run.smithi121.stdout: crimson alien thread cpu cores = 6-7 2024-09-16T07:33:14.063 INFO:teuthology.orchestra.run.smithi121.stdout: crimson osd obc lru size = 10 2024-09-16T07:33:14.063 INFO:teuthology.orchestra.run.smithi121.stdout: debug bluefs = 20 2024-09-16T07:33:14.063 INFO:teuthology.orchestra.run.smithi121.stdout: debug bluestore = 20 2024-09-16T07:33:14.063 INFO:teuthology.orchestra.run.smithi121.stdout: debug ms = 1 2024-09-16T07:33:14.063 INFO:teuthology.orchestra.run.smithi121.stdout: debug osd = 20 2024-09-16T07:33:14.063 INFO:teuthology.orchestra.run.smithi121.stdout: debug rocksdb = 10 2024-09-16T07:33:14.063 INFO:teuthology.orchestra.run.smithi121.stdout: err to stderr = True 2024-09-16T07:33:14.063 INFO:teuthology.orchestra.run.smithi121.stdout: log flush on exit = True 2024-09-16T07:33:14.063 INFO:teuthology.orchestra.run.smithi121.stdout: log to file = False 2024-09-16T07:33:14.063 INFO:teuthology.orchestra.run.smithi121.stdout: log to stderr = True 2024-09-16T07:33:14.063 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd backfillfull_ratio = 0.85 2024-09-16T07:33:14.063 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd full ratio = 0.9 2024-09-16T07:33:14.064 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd nearfull ratio = 0.8 2024-09-16T07:33:14.064 INFO:teuthology.orchestra.run.smithi121.stdout: osd blocked scrub grace period = 3600 2024-09-16T07:33:14.064 INFO:teuthology.orchestra.run.smithi121.stdout: osd class default list = * 2024-09-16T07:33:14.064 INFO:teuthology.orchestra.run.smithi121.stdout: osd class load list = * 2024-09-16T07:33:14.064 INFO:teuthology.orchestra.run.smithi121.stdout: osd failsafe full ratio = 0.95 2024-09-16T07:33:14.064 INFO:teuthology.orchestra.run.smithi121.stdout: osd objectstore = bluestore 2024-09-16T07:33:14.064 INFO:teuthology.orchestra.run.smithi121.stdout: osd shutdown pgref assert = True 2024-09-16T07:33:14.064 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:33:14.064 INFO:teuthology.orchestra.run.smithi121.stdout:[mgr] 2024-09-16T07:33:14.064 INFO:teuthology.orchestra.run.smithi121.stdout: debug ms = 1 2024-09-16T07:33:14.064 INFO:teuthology.orchestra.run.smithi121.stdout: debug mgr = 20 2024-09-16T07:33:14.064 INFO:teuthology.orchestra.run.smithi121.stdout: debug mon = 20 2024-09-16T07:33:14.064 INFO:teuthology.orchestra.run.smithi121.stdout: debug auth = 20 2024-09-16T07:33:14.064 INFO:teuthology.orchestra.run.smithi121.stdout: mon reweight min pgs per osd = 4 2024-09-16T07:33:14.064 INFO:teuthology.orchestra.run.smithi121.stdout: mon reweight min bytes per osd = 10 2024-09-16T07:33:14.065 INFO:teuthology.orchestra.run.smithi121.stdout: mgr/telemetry/nag = false 2024-09-16T07:33:14.065 INFO:teuthology.orchestra.run.smithi121.stdout: mgr stats period = 30 2024-09-16T07:33:14.065 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:33:14.065 INFO:teuthology.orchestra.run.smithi121.stdout:[mon] 2024-09-16T07:33:14.065 INFO:teuthology.orchestra.run.smithi121.stdout: debug ms = 1 2024-09-16T07:33:14.065 INFO:teuthology.orchestra.run.smithi121.stdout: debug mon = 20 2024-09-16T07:33:14.065 INFO:teuthology.orchestra.run.smithi121.stdout: debug paxos = 20 2024-09-16T07:33:14.065 INFO:teuthology.orchestra.run.smithi121.stdout: debug auth = 20 2024-09-16T07:33:14.065 INFO:teuthology.orchestra.run.smithi121.stdout: mon data avail warn = 5 2024-09-16T07:33:14.065 INFO:teuthology.orchestra.run.smithi121.stdout: mon mgr mkfs grace = 240 2024-09-16T07:33:14.065 INFO:teuthology.orchestra.run.smithi121.stdout: mon reweight min pgs per osd = 4 2024-09-16T07:33:14.066 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd reporter subtree level = osd 2024-09-16T07:33:14.066 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd prime pg temp = true 2024-09-16T07:33:14.066 INFO:teuthology.orchestra.run.smithi121.stdout: mon reweight min bytes per osd = 10 2024-09-16T07:33:14.066 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:33:14.066 INFO:teuthology.orchestra.run.smithi121.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-16T07:33:14.066 INFO:teuthology.orchestra.run.smithi121.stdout: auth mon ticket ttl = 660 # 11m 2024-09-16T07:33:14.066 INFO:teuthology.orchestra.run.smithi121.stdout: auth service ticket ttl = 240 # 4m 2024-09-16T07:33:14.066 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:33:14.066 INFO:teuthology.orchestra.run.smithi121.stdout: # don't complain about insecure global_id in the test suite 2024-09-16T07:33:14.066 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-16T07:33:14.066 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-16T07:33:14.066 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:33:14.066 INFO:teuthology.orchestra.run.smithi121.stdout: # 1m isn't quite enough 2024-09-16T07:33:14.066 INFO:teuthology.orchestra.run.smithi121.stdout: mon_down_mkfs_grace = 2m 2024-09-16T07:33:14.066 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:33:14.067 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_filestore_osds = false 2024-09-16T07:33:14.067 INFO:teuthology.orchestra.run.smithi121.stdout: mon min osdmap epochs = 50 2024-09-16T07:33:14.067 INFO:teuthology.orchestra.run.smithi121.stdout: mon osdmap full prune interval = 2 2024-09-16T07:33:14.067 INFO:teuthology.orchestra.run.smithi121.stdout: mon osdmap full prune min = 15 2024-09-16T07:33:14.067 INFO:teuthology.orchestra.run.smithi121.stdout: mon osdmap full prune txsize = 2 2024-09-16T07:33:14.067 INFO:teuthology.orchestra.run.smithi121.stdout: paxos service trim min = 10 2024-09-16T07:33:14.067 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on pool no app = False 2024-09-16T07:33:14.067 INFO:teuthology.orchestra.run.smithi121.stdout: osd pool default crimson = True 2024-09-16T07:33:14.067 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:33:14.067 INFO:teuthology.orchestra.run.smithi121.stdout:[client] 2024-09-16T07:33:14.067 INFO:teuthology.orchestra.run.smithi121.stdout: rgw cache enabled = true 2024-09-16T07:33:14.067 INFO:teuthology.orchestra.run.smithi121.stdout: rgw enable ops log = true 2024-09-16T07:33:14.067 INFO:teuthology.orchestra.run.smithi121.stdout: rgw enable usage log = true 2024-09-16T07:33:14.068 INFO:teuthology.orchestra.run.smithi121.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-16T07:33:14.068 INFO:teuthology.orchestra.run.smithi121.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-16T07:33:14.068 INFO:teuthology.orchestra.run.smithi121.stdout: debug ms = 1 2024-09-16T07:33:14.068 INFO:teuthology.orchestra.run.smithi121.stdout:[mon.a] 2024-09-16T07:33:14.068 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.0] 2024-09-16T07:33:14.068 INFO:teuthology.orchestra.run.smithi121.stdout: crimson seastar cpu cores = 0-2 2024-09-16T07:33:14.068 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.1] 2024-09-16T07:33:14.068 INFO:teuthology.orchestra.run.smithi121.stdout: crimson seastar cpu cores = 3-5 2024-09-16T07:33:14.068 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.2] 2024-09-16T07:33:14.068 INFO:teuthology.orchestra.run.smithi121.stdout: crimson seastar cpu cores = 0-2 2024-09-16T07:33:14.068 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.3] 2024-09-16T07:33:14.068 INFO:teuthology.orchestra.run.smithi121.stdout: crimson seastar cpu cores = 3-5 2024-09-16T07:33:14.069 INFO:teuthology.orchestra.run.smithi172.stdout:[global] 2024-09-16T07:33:14.069 INFO:teuthology.orchestra.run.smithi172.stdout: chdir = "" 2024-09-16T07:33:14.069 INFO:teuthology.orchestra.run.smithi172.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-16T07:33:14.069 INFO:teuthology.orchestra.run.smithi172.stdout: auth supported = cephx 2024-09-16T07:33:14.069 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:33:14.069 INFO:teuthology.orchestra.run.smithi172.stdout: filestore xattr use omap = true 2024-09-16T07:33:14.069 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:33:14.069 INFO:teuthology.orchestra.run.smithi172.stdout: mon clock drift allowed = 1.000 2024-09-16T07:33:14.069 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:33:14.070 INFO:teuthology.orchestra.run.smithi172.stdout: osd crush chooseleaf type = 0 2024-09-16T07:33:14.070 INFO:teuthology.orchestra.run.smithi172.stdout: auth debug = true 2024-09-16T07:33:14.070 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:33:14.070 INFO:teuthology.orchestra.run.smithi172.stdout: ms die on old message = true 2024-09-16T07:33:14.070 INFO:teuthology.orchestra.run.smithi172.stdout: ms die on bug = true 2024-09-16T07:33:14.070 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:33:14.070 INFO:teuthology.orchestra.run.smithi172.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-16T07:33:14.070 INFO:teuthology.orchestra.run.smithi172.stdout: mon pg warn max object skew = 0 2024-09-16T07:33:14.070 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:33:14.070 INFO:teuthology.orchestra.run.smithi172.stdout: # disable pg_autoscaler by default for new pools 2024-09-16T07:33:14.070 INFO:teuthology.orchestra.run.smithi172.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-16T07:33:14.070 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:33:14.070 INFO:teuthology.orchestra.run.smithi172.stdout: osd pool default size = 2 2024-09-16T07:33:14.071 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:33:14.071 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd allow primary affinity = true 2024-09-16T07:33:14.071 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd allow pg remap = true 2024-09-16T07:33:14.071 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on legacy crush tunables = false 2024-09-16T07:33:14.071 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on crush straw calc version zero = false 2024-09-16T07:33:14.071 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on no sortbitwise = false 2024-09-16T07:33:14.071 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on osd down out interval zero = false 2024-09-16T07:33:14.071 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on too few osds = false 2024-09-16T07:33:14.071 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-16T07:33:14.071 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-16T07:33:14.071 INFO:teuthology.orchestra.run.smithi172.stdout: mon_allow_pool_size_one = true 2024-09-16T07:33:14.071 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:33:14.071 INFO:teuthology.orchestra.run.smithi172.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-16T07:33:14.071 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:33:14.072 INFO:teuthology.orchestra.run.smithi172.stdout: osd default data pool replay window = 5 2024-09-16T07:33:14.072 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:33:14.072 INFO:teuthology.orchestra.run.smithi172.stdout: mon allow pool delete = true 2024-09-16T07:33:14.072 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:33:14.072 INFO:teuthology.orchestra.run.smithi172.stdout: mon cluster log file level = debug 2024-09-16T07:33:14.072 INFO:teuthology.orchestra.run.smithi172.stdout: debug asserts on shutdown = true 2024-09-16T07:33:14.072 INFO:teuthology.orchestra.run.smithi172.stdout: mon health detail to clog = false 2024-09-16T07:33:14.072 INFO:teuthology.orchestra.run.smithi172.stdout: mon host = 172.21.15.121 2024-09-16T07:33:14.072 INFO:teuthology.orchestra.run.smithi172.stdout: enable experimental unrecoverable data corrupting features = crimson 2024-09-16T07:33:14.072 INFO:teuthology.orchestra.run.smithi172.stdout: ms client mode = crc 2024-09-16T07:33:14.073 INFO:teuthology.orchestra.run.smithi172.stdout: ms cluster mode = crc 2024-09-16T07:33:14.073 INFO:teuthology.orchestra.run.smithi172.stdout: ms mon client mode = crc 2024-09-16T07:33:14.073 INFO:teuthology.orchestra.run.smithi172.stdout: ms mon cluster mode = crc 2024-09-16T07:33:14.073 INFO:teuthology.orchestra.run.smithi172.stdout: ms mon service mode = crc 2024-09-16T07:33:14.073 INFO:teuthology.orchestra.run.smithi172.stdout: ms service mode = crc 2024-09-16T07:33:14.073 INFO:teuthology.orchestra.run.smithi172.stdout: fsid = 5b0c4070-0374-47d9-9f2a-f525ac27c89c 2024-09-16T07:33:14.073 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:33:14.073 INFO:teuthology.orchestra.run.smithi172.stdout:[osd] 2024-09-16T07:33:14.073 INFO:teuthology.orchestra.run.smithi172.stdout: osd journal size = 100 2024-09-16T07:33:14.073 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:33:14.073 INFO:teuthology.orchestra.run.smithi172.stdout: osd scrub load threshold = 5.0 2024-09-16T07:33:14.073 INFO:teuthology.orchestra.run.smithi172.stdout: osd scrub max interval = 600 2024-09-16T07:33:14.073 INFO:teuthology.orchestra.run.smithi172.stdout: osd mclock profile = high_recovery_ops 2024-09-16T07:33:14.074 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:33:14.074 INFO:teuthology.orchestra.run.smithi172.stdout: osd recover clone overlap = true 2024-09-16T07:33:14.074 INFO:teuthology.orchestra.run.smithi172.stdout: osd recovery max chunk = 1048576 2024-09-16T07:33:14.074 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:33:14.074 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug shutdown = true 2024-09-16T07:33:14.074 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug op order = true 2024-09-16T07:33:14.074 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug verify stray on activate = true 2024-09-16T07:33:14.074 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug trim objects = true 2024-09-16T07:33:14.074 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:33:14.074 INFO:teuthology.orchestra.run.smithi172.stdout: osd open classes on start = true 2024-09-16T07:33:14.074 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug pg log writeout = true 2024-09-16T07:33:14.074 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:33:14.074 INFO:teuthology.orchestra.run.smithi172.stdout: osd deep scrub update digest min age = 30 2024-09-16T07:33:14.074 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:33:14.074 INFO:teuthology.orchestra.run.smithi172.stdout: osd map max advance = 10 2024-09-16T07:33:14.075 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:33:14.075 INFO:teuthology.orchestra.run.smithi172.stdout: journal zero on create = true 2024-09-16T07:33:14.075 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:33:14.075 INFO:teuthology.orchestra.run.smithi172.stdout: filestore ondisk finisher threads = 3 2024-09-16T07:33:14.075 INFO:teuthology.orchestra.run.smithi172.stdout: filestore apply finisher threads = 3 2024-09-16T07:33:14.075 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:33:14.075 INFO:teuthology.orchestra.run.smithi172.stdout: bdev debug aio = true 2024-09-16T07:33:14.075 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug misdirected ops = true 2024-09-16T07:33:14.075 INFO:teuthology.orchestra.run.smithi172.stdout: debug monc = 20 2024-09-16T07:33:14.075 INFO:teuthology.orchestra.run.smithi172.stdout: bluestore block size = 96636764160 2024-09-16T07:33:14.075 INFO:teuthology.orchestra.run.smithi172.stdout: bluestore compression algorithm = snappy 2024-09-16T07:33:14.075 INFO:teuthology.orchestra.run.smithi172.stdout: bluestore compression mode = aggressive 2024-09-16T07:33:14.075 INFO:teuthology.orchestra.run.smithi172.stdout: bluestore fsck on mount = True 2024-09-16T07:33:14.075 INFO:teuthology.orchestra.run.smithi172.stdout: bluestore rocksdb cf = False 2024-09-16T07:33:14.076 INFO:teuthology.orchestra.run.smithi172.stdout: crimson alien thread cpu cores = 6-7 2024-09-16T07:33:14.076 INFO:teuthology.orchestra.run.smithi172.stdout: crimson osd obc lru size = 10 2024-09-16T07:33:14.076 INFO:teuthology.orchestra.run.smithi172.stdout: debug bluefs = 20 2024-09-16T07:33:14.076 INFO:teuthology.orchestra.run.smithi172.stdout: debug bluestore = 20 2024-09-16T07:33:14.076 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2024-09-16T07:33:14.076 INFO:teuthology.orchestra.run.smithi172.stdout: debug osd = 20 2024-09-16T07:33:14.076 INFO:teuthology.orchestra.run.smithi172.stdout: debug rocksdb = 10 2024-09-16T07:33:14.076 INFO:teuthology.orchestra.run.smithi172.stdout: err to stderr = True 2024-09-16T07:33:14.076 INFO:teuthology.orchestra.run.smithi172.stdout: log flush on exit = True 2024-09-16T07:33:14.076 INFO:teuthology.orchestra.run.smithi172.stdout: log to file = False 2024-09-16T07:33:14.076 INFO:teuthology.orchestra.run.smithi172.stdout: log to stderr = True 2024-09-16T07:33:14.076 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd backfillfull_ratio = 0.85 2024-09-16T07:33:14.076 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd full ratio = 0.9 2024-09-16T07:33:14.077 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd nearfull ratio = 0.8 2024-09-16T07:33:14.077 INFO:teuthology.orchestra.run.smithi172.stdout: osd blocked scrub grace period = 3600 2024-09-16T07:33:14.077 INFO:teuthology.orchestra.run.smithi172.stdout: osd class default list = * 2024-09-16T07:33:14.077 INFO:teuthology.orchestra.run.smithi172.stdout: osd class load list = * 2024-09-16T07:33:14.077 INFO:teuthology.orchestra.run.smithi172.stdout: osd failsafe full ratio = 0.95 2024-09-16T07:33:14.077 INFO:teuthology.orchestra.run.smithi172.stdout: osd objectstore = bluestore 2024-09-16T07:33:14.077 INFO:teuthology.orchestra.run.smithi172.stdout: osd shutdown pgref assert = True 2024-09-16T07:33:14.077 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:33:14.077 INFO:teuthology.orchestra.run.smithi172.stdout:[mgr] 2024-09-16T07:33:14.077 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2024-09-16T07:33:14.077 INFO:teuthology.orchestra.run.smithi172.stdout: debug mgr = 20 2024-09-16T07:33:14.077 INFO:teuthology.orchestra.run.smithi172.stdout: debug mon = 20 2024-09-16T07:33:14.077 INFO:teuthology.orchestra.run.smithi172.stdout: debug auth = 20 2024-09-16T07:33:14.077 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min pgs per osd = 4 2024-09-16T07:33:14.078 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min bytes per osd = 10 2024-09-16T07:33:14.078 INFO:teuthology.orchestra.run.smithi172.stdout: mgr/telemetry/nag = false 2024-09-16T07:33:14.078 INFO:teuthology.orchestra.run.smithi172.stdout: mgr stats period = 30 2024-09-16T07:33:14.078 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:33:14.078 INFO:teuthology.orchestra.run.smithi172.stdout:[mon] 2024-09-16T07:33:14.078 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2024-09-16T07:33:14.078 INFO:teuthology.orchestra.run.smithi172.stdout: debug mon = 20 2024-09-16T07:33:14.078 INFO:teuthology.orchestra.run.smithi172.stdout: debug paxos = 20 2024-09-16T07:33:14.079 INFO:teuthology.orchestra.run.smithi172.stdout: debug auth = 20 2024-09-16T07:33:14.079 INFO:teuthology.orchestra.run.smithi172.stdout: mon data avail warn = 5 2024-09-16T07:33:14.079 INFO:teuthology.orchestra.run.smithi172.stdout: mon mgr mkfs grace = 240 2024-09-16T07:33:14.079 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min pgs per osd = 4 2024-09-16T07:33:14.079 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd reporter subtree level = osd 2024-09-16T07:33:14.079 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd prime pg temp = true 2024-09-16T07:33:14.079 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min bytes per osd = 10 2024-09-16T07:33:14.079 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:33:14.079 INFO:teuthology.orchestra.run.smithi172.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-16T07:33:14.079 INFO:teuthology.orchestra.run.smithi172.stdout: auth mon ticket ttl = 660 # 11m 2024-09-16T07:33:14.079 INFO:teuthology.orchestra.run.smithi172.stdout: auth service ticket ttl = 240 # 4m 2024-09-16T07:33:14.079 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:33:14.079 INFO:teuthology.orchestra.run.smithi172.stdout: # don't complain about insecure global_id in the test suite 2024-09-16T07:33:14.079 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-16T07:33:14.080 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-16T07:33:14.080 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:33:14.080 INFO:teuthology.orchestra.run.smithi172.stdout: # 1m isn't quite enough 2024-09-16T07:33:14.080 INFO:teuthology.orchestra.run.smithi172.stdout: mon_down_mkfs_grace = 2m 2024-09-16T07:33:14.080 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:33:14.080 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_filestore_osds = false 2024-09-16T07:33:14.080 INFO:teuthology.orchestra.run.smithi172.stdout: mon min osdmap epochs = 50 2024-09-16T07:33:14.080 INFO:teuthology.orchestra.run.smithi172.stdout: mon osdmap full prune interval = 2 2024-09-16T07:33:14.080 INFO:teuthology.orchestra.run.smithi172.stdout: mon osdmap full prune min = 15 2024-09-16T07:33:14.080 INFO:teuthology.orchestra.run.smithi172.stdout: mon osdmap full prune txsize = 2 2024-09-16T07:33:14.080 INFO:teuthology.orchestra.run.smithi172.stdout: paxos service trim min = 10 2024-09-16T07:33:14.080 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on pool no app = False 2024-09-16T07:33:14.080 INFO:teuthology.orchestra.run.smithi172.stdout: osd pool default crimson = True 2024-09-16T07:33:14.080 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-16T07:33:14.081 INFO:teuthology.orchestra.run.smithi172.stdout:[client] 2024-09-16T07:33:14.081 INFO:teuthology.orchestra.run.smithi172.stdout: rgw cache enabled = true 2024-09-16T07:33:14.081 INFO:teuthology.orchestra.run.smithi172.stdout: rgw enable ops log = true 2024-09-16T07:33:14.081 INFO:teuthology.orchestra.run.smithi172.stdout: rgw enable usage log = true 2024-09-16T07:33:14.081 INFO:teuthology.orchestra.run.smithi172.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-16T07:33:14.081 INFO:teuthology.orchestra.run.smithi172.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-16T07:33:14.081 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2024-09-16T07:33:14.081 INFO:teuthology.orchestra.run.smithi172.stdout:[mon.a] 2024-09-16T07:33:14.081 INFO:teuthology.orchestra.run.smithi172.stdout:[osd.0] 2024-09-16T07:33:14.081 INFO:teuthology.orchestra.run.smithi172.stdout: crimson seastar cpu cores = 0-2 2024-09-16T07:33:14.081 INFO:teuthology.orchestra.run.smithi172.stdout:[osd.1] 2024-09-16T07:33:14.081 INFO:teuthology.orchestra.run.smithi172.stdout: crimson seastar cpu cores = 3-5 2024-09-16T07:33:14.081 INFO:teuthology.orchestra.run.smithi172.stdout:[osd.2] 2024-09-16T07:33:14.081 INFO:teuthology.orchestra.run.smithi172.stdout: crimson seastar cpu cores = 0-2 2024-09-16T07:33:14.082 INFO:teuthology.orchestra.run.smithi172.stdout:[osd.3] 2024-09-16T07:33:14.082 INFO:teuthology.orchestra.run.smithi172.stdout: crimson seastar cpu cores = 3-5 2024-09-16T07:33:14.083 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-16T07:33:14.083 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-16T07:33:14.188 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-16T07:33:14.188 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-16T07:33:14.189 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-16T07:33:14.204 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-16T07:33:14.205 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-16T07:33:14.260 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi121.front.sepia.ceph.com 2024-09-16T07:33:14.260 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-16T07:33:14.261 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-16T07:33:14.261 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-16T07:33:14.337 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-16T07:33:14.338 DEBUG:teuthology.orchestra.run.smithi121:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-16T07:33:14.394 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi172.front.sepia.ceph.com 2024-09-16T07:33:14.394 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-16T07:33:14.394 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-16T07:33:14.394 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-16T07:33:14.430 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-16T07:33:14.430 DEBUG:teuthology.orchestra.run.smithi172:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-16T07:33:14.487 INFO:tasks.ceph:Setting up mon nodes... 2024-09-16T07:33:14.487 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-16T07:33:14.487 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-16T07:33:14.594 INFO:teuthology.orchestra.run.smithi172.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-16T07:33:14.597 INFO:tasks.ceph:Setting up mds nodes... 2024-09-16T07:33:14.598 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-16T07:33:14.598 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-16T07:33:14.648 INFO:teuthology.orchestra.run.smithi121.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-16T07:33:14.661 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-16T07:33:14.711 INFO:teuthology.orchestra.run.smithi172.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-16T07:33:14.724 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-16T07:33:14.724 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi121.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi172.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2024-09-16T07:33:14.725 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-16T07:33:14.749 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2024-09-16T07:33:14.749 INFO:tasks.ceph:role: osd.0 2024-09-16T07:33:14.750 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi121.front.sepia.ceph.com 2024-09-16T07:33:14.750 DEBUG:teuthology.orchestra.run.smithi121:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-16T07:33:14.822 INFO:teuthology.orchestra.run.smithi121.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T07:33:14.822 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T07:33:14.822 INFO:teuthology.orchestra.run.smithi121.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T07:33:14.822 INFO:teuthology.orchestra.run.smithi121.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-16T07:33:14.822 INFO:teuthology.orchestra.run.smithi121.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T07:33:14.822 INFO:teuthology.orchestra.run.smithi121.stdout: = sunit=0 swidth=0 blks 2024-09-16T07:33:14.822 INFO:teuthology.orchestra.run.smithi121.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T07:33:14.823 INFO:teuthology.orchestra.run.smithi121.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-16T07:33:14.823 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T07:33:14.823 INFO:teuthology.orchestra.run.smithi121.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T07:33:15.337 INFO:teuthology.orchestra.run.smithi121.stdout:Discarding blocks...Done. 2024-09-16T07:33:15.339 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi121.front.sepia.ceph.com -o noatime 2024-09-16T07:33:15.339 DEBUG:teuthology.orchestra.run.smithi121:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-16T07:33:15.453 DEBUG:teuthology.orchestra.run.smithi121:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-16T07:33:15.486 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-16T07:33:15.552 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2024-09-16T07:33:15.552 INFO:tasks.ceph:role: osd.1 2024-09-16T07:33:15.552 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi121.front.sepia.ceph.com 2024-09-16T07:33:15.552 DEBUG:teuthology.orchestra.run.smithi121:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-16T07:33:15.626 INFO:teuthology.orchestra.run.smithi121.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T07:33:15.626 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T07:33:15.626 INFO:teuthology.orchestra.run.smithi121.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T07:33:15.626 INFO:teuthology.orchestra.run.smithi121.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-16T07:33:15.626 INFO:teuthology.orchestra.run.smithi121.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T07:33:15.626 INFO:teuthology.orchestra.run.smithi121.stdout: = sunit=0 swidth=0 blks 2024-09-16T07:33:15.626 INFO:teuthology.orchestra.run.smithi121.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T07:33:15.626 INFO:teuthology.orchestra.run.smithi121.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-16T07:33:15.626 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T07:33:15.627 INFO:teuthology.orchestra.run.smithi121.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T07:33:16.086 INFO:teuthology.orchestra.run.smithi121.stdout:Discarding blocks...Done. 2024-09-16T07:33:16.089 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi121.front.sepia.ceph.com -o noatime 2024-09-16T07:33:16.090 DEBUG:teuthology.orchestra.run.smithi121:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-16T07:33:16.183 DEBUG:teuthology.orchestra.run.smithi121:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-16T07:33:16.213 DEBUG:teuthology.orchestra.run.smithi121:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T07:33:16.523 INFO:teuthology.orchestra.run.smithi121.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T07:33:16.524 INFO:teuthology.orchestra.run.smithi121.stderr:INFO 2024-09-16 07:33:16,525 seastar - Reactor backend: linux-aio 2024-09-16T07:33:16.538 INFO:teuthology.orchestra.run.smithi121.stderr:==27757==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T07:33:16.659 INFO:teuthology.orchestra.run.smithi121.stderr:INFO 2024-09-16 07:33:16,661 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-16T07:33:16.659 INFO:teuthology.orchestra.run.smithi121.stderr:INFO 2024-09-16 07:33:16,661 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 0-2 2024-09-16T07:33:16.660 INFO:teuthology.orchestra.run.smithi121.stderr:DEBUG 2024-09-16 07:33:16,662 [shard 0:main] seastar - reactor::drain 2024-09-16T07:33:17.179 INFO:teuthology.orchestra.run.smithi121.stderr:----------------------------------------------------- 2024-09-16T07:33:17.180 INFO:teuthology.orchestra.run.smithi121.stderr:Suppressions used: 2024-09-16T07:33:17.180 INFO:teuthology.orchestra.run.smithi121.stderr: count bytes template 2024-09-16T07:33:17.180 INFO:teuthology.orchestra.run.smithi121.stderr: 1 8 MallocExtension::Register 2024-09-16T07:33:17.180 INFO:teuthology.orchestra.run.smithi121.stderr:----------------------------------------------------- 2024-09-16T07:33:17.180 INFO:teuthology.orchestra.run.smithi121.stderr: 2024-09-16T07:33:17.241 INFO:teuthology.orchestra.run.smithi121.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T07:33:17.245 INFO:teuthology.orchestra.run.smithi121.stderr:INFO 2024-09-16 07:33:17,246 seastar - Reactor backend: linux-aio 2024-09-16T07:33:17.254 INFO:teuthology.orchestra.run.smithi121.stderr:==27755==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T07:33:17.352 INFO:teuthology.orchestra.run.smithi121.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x125019 0x421f3 0x3ef7b 0xfd531 0x361b453 0x361b65c 0x362a2bb 0x382b1d8 0x416dc9b 0x5fb8ce4 0x5fb8ee0 0x5fb946c 0x5e00fef 0x5e19231 0x71579d2 0x71691a5 0x716a642 0x716a6c7 0x716a7c9 0x716a8c1 0x716aace 0x716acb4 0x716b003 0x716b3a7 0x716b5d7 0x716b841 0x716bb0e 0x716bd2c 0x716bde4 0x716beaa 0x716bf8b 0x5c63e30 0x5c63f3a 0x5c63ff6 0x5c640b2 0x5c6416e 0x5c642bb 0x5c64446 0x5c64807 0x5c7e60a 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T07:33:17.352 INFO:teuthology.orchestra.run.smithi121.stderr:kernel callstack: 2024-09-16T07:33:21.939 INFO:teuthology.orchestra.run.smithi121.stderr:----------------------------------------------------- 2024-09-16T07:33:21.939 INFO:teuthology.orchestra.run.smithi121.stderr:Suppressions used: 2024-09-16T07:33:21.939 INFO:teuthology.orchestra.run.smithi121.stderr: count bytes template 2024-09-16T07:33:21.939 INFO:teuthology.orchestra.run.smithi121.stderr: 1 8 MallocExtension::Register 2024-09-16T07:33:21.939 INFO:teuthology.orchestra.run.smithi121.stderr:----------------------------------------------------- 2024-09-16T07:33:21.939 INFO:teuthology.orchestra.run.smithi121.stderr: 2024-09-16T07:33:21.962 DEBUG:teuthology.orchestra.run.smithi121:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-16T07:33:21.986 DEBUG:teuthology.orchestra.run.smithi121:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T07:33:22.264 INFO:teuthology.orchestra.run.smithi121.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T07:33:22.265 INFO:teuthology.orchestra.run.smithi121.stderr:INFO 2024-09-16 07:33:22,266 seastar - Reactor backend: linux-aio 2024-09-16T07:33:22.270 INFO:teuthology.orchestra.run.smithi121.stderr:==27943==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T07:33:22.391 INFO:teuthology.orchestra.run.smithi121.stderr:INFO 2024-09-16 07:33:22,393 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-16T07:33:22.391 INFO:teuthology.orchestra.run.smithi121.stderr:INFO 2024-09-16 07:33:22,393 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 3-5 2024-09-16T07:33:22.391 INFO:teuthology.orchestra.run.smithi121.stderr:DEBUG 2024-09-16 07:33:22,393 [shard 0:main] seastar - reactor::drain 2024-09-16T07:33:22.893 INFO:teuthology.orchestra.run.smithi121.stderr:----------------------------------------------------- 2024-09-16T07:33:22.893 INFO:teuthology.orchestra.run.smithi121.stderr:Suppressions used: 2024-09-16T07:33:22.893 INFO:teuthology.orchestra.run.smithi121.stderr: count bytes template 2024-09-16T07:33:22.893 INFO:teuthology.orchestra.run.smithi121.stderr: 1 8 MallocExtension::Register 2024-09-16T07:33:22.893 INFO:teuthology.orchestra.run.smithi121.stderr:----------------------------------------------------- 2024-09-16T07:33:22.894 INFO:teuthology.orchestra.run.smithi121.stderr: 2024-09-16T07:33:22.952 INFO:teuthology.orchestra.run.smithi121.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T07:33:22.955 INFO:teuthology.orchestra.run.smithi121.stderr:INFO 2024-09-16 07:33:22,957 seastar - Reactor backend: linux-aio 2024-09-16T07:33:22.973 INFO:teuthology.orchestra.run.smithi121.stderr:==27941==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T07:33:27.906 INFO:teuthology.orchestra.run.smithi121.stderr:----------------------------------------------------- 2024-09-16T07:33:27.907 INFO:teuthology.orchestra.run.smithi121.stderr:Suppressions used: 2024-09-16T07:33:27.907 INFO:teuthology.orchestra.run.smithi121.stderr: count bytes template 2024-09-16T07:33:27.907 INFO:teuthology.orchestra.run.smithi121.stderr: 1 8 MallocExtension::Register 2024-09-16T07:33:27.907 INFO:teuthology.orchestra.run.smithi121.stderr:----------------------------------------------------- 2024-09-16T07:33:27.907 INFO:teuthology.orchestra.run.smithi121.stderr: 2024-09-16T07:33:27.928 DEBUG:teuthology.orchestra.run.smithi121:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-16T07:33:27.953 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-16T07:33:27.982 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2024-09-16T07:33:27.983 INFO:tasks.ceph:role: osd.2 2024-09-16T07:33:27.983 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi172.front.sepia.ceph.com 2024-09-16T07:33:27.983 DEBUG:teuthology.orchestra.run.smithi172:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-16T07:33:28.059 INFO:teuthology.orchestra.run.smithi172.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T07:33:28.059 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T07:33:28.059 INFO:teuthology.orchestra.run.smithi172.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T07:33:28.059 INFO:teuthology.orchestra.run.smithi172.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-16T07:33:28.059 INFO:teuthology.orchestra.run.smithi172.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T07:33:28.060 INFO:teuthology.orchestra.run.smithi172.stdout: = sunit=0 swidth=0 blks 2024-09-16T07:33:28.060 INFO:teuthology.orchestra.run.smithi172.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T07:33:28.060 INFO:teuthology.orchestra.run.smithi172.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-16T07:33:28.060 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T07:33:28.060 INFO:teuthology.orchestra.run.smithi172.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T07:33:28.555 INFO:teuthology.orchestra.run.smithi172.stdout:Discarding blocks...Done. 2024-09-16T07:33:28.557 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi172.front.sepia.ceph.com -o noatime 2024-09-16T07:33:28.558 DEBUG:teuthology.orchestra.run.smithi172:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-09-16T07:33:28.694 DEBUG:teuthology.orchestra.run.smithi172:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-16T07:33:28.731 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-16T07:33:28.799 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2024-09-16T07:33:28.799 INFO:tasks.ceph:role: osd.3 2024-09-16T07:33:28.799 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi172.front.sepia.ceph.com 2024-09-16T07:33:28.799 DEBUG:teuthology.orchestra.run.smithi172:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-16T07:33:28.875 INFO:teuthology.orchestra.run.smithi172.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T07:33:28.875 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T07:33:28.875 INFO:teuthology.orchestra.run.smithi172.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T07:33:28.875 INFO:teuthology.orchestra.run.smithi172.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-16T07:33:28.875 INFO:teuthology.orchestra.run.smithi172.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T07:33:28.875 INFO:teuthology.orchestra.run.smithi172.stdout: = sunit=0 swidth=0 blks 2024-09-16T07:33:28.875 INFO:teuthology.orchestra.run.smithi172.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T07:33:28.875 INFO:teuthology.orchestra.run.smithi172.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-16T07:33:28.875 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T07:33:28.875 INFO:teuthology.orchestra.run.smithi172.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T07:33:29.327 INFO:teuthology.orchestra.run.smithi172.stdout:Discarding blocks...Done. 2024-09-16T07:33:29.329 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi172.front.sepia.ceph.com -o noatime 2024-09-16T07:33:29.329 DEBUG:teuthology.orchestra.run.smithi172:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-3 2024-09-16T07:33:29.421 DEBUG:teuthology.orchestra.run.smithi172:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-16T07:33:29.450 DEBUG:teuthology.orchestra.run.smithi172:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T07:33:29.811 INFO:teuthology.orchestra.run.smithi172.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T07:33:29.812 INFO:teuthology.orchestra.run.smithi172.stderr:INFO 2024-09-16 07:33:29,813 seastar - Reactor backend: linux-aio 2024-09-16T07:33:29.831 INFO:teuthology.orchestra.run.smithi172.stderr:==27598==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T07:33:29.958 INFO:teuthology.orchestra.run.smithi172.stderr:INFO 2024-09-16 07:33:29,959 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-16T07:33:29.959 INFO:teuthology.orchestra.run.smithi172.stderr:INFO 2024-09-16 07:33:29,959 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 0-2 2024-09-16T07:33:29.959 INFO:teuthology.orchestra.run.smithi172.stderr:DEBUG 2024-09-16 07:33:29,960 [shard 0:main] seastar - reactor::drain 2024-09-16T07:33:30.514 INFO:teuthology.orchestra.run.smithi172.stderr:----------------------------------------------------- 2024-09-16T07:33:30.515 INFO:teuthology.orchestra.run.smithi172.stderr:Suppressions used: 2024-09-16T07:33:30.515 INFO:teuthology.orchestra.run.smithi172.stderr: count bytes template 2024-09-16T07:33:30.515 INFO:teuthology.orchestra.run.smithi172.stderr: 1 8 MallocExtension::Register 2024-09-16T07:33:30.515 INFO:teuthology.orchestra.run.smithi172.stderr:----------------------------------------------------- 2024-09-16T07:33:30.515 INFO:teuthology.orchestra.run.smithi172.stderr: 2024-09-16T07:33:30.574 INFO:teuthology.orchestra.run.smithi172.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T07:33:30.578 INFO:teuthology.orchestra.run.smithi172.stderr:INFO 2024-09-16 07:33:30,580 seastar - Reactor backend: linux-aio 2024-09-16T07:33:30.588 INFO:teuthology.orchestra.run.smithi172.stderr:==27594==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T07:33:35.271 INFO:teuthology.orchestra.run.smithi172.stderr:----------------------------------------------------- 2024-09-16T07:33:35.271 INFO:teuthology.orchestra.run.smithi172.stderr:Suppressions used: 2024-09-16T07:33:35.271 INFO:teuthology.orchestra.run.smithi172.stderr: count bytes template 2024-09-16T07:33:35.271 INFO:teuthology.orchestra.run.smithi172.stderr: 1 8 MallocExtension::Register 2024-09-16T07:33:35.271 INFO:teuthology.orchestra.run.smithi172.stderr:----------------------------------------------------- 2024-09-16T07:33:35.271 INFO:teuthology.orchestra.run.smithi172.stderr: 2024-09-16T07:33:35.293 DEBUG:teuthology.orchestra.run.smithi172:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-16T07:33:35.318 DEBUG:teuthology.orchestra.run.smithi172:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T07:33:35.595 INFO:teuthology.orchestra.run.smithi172.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T07:33:35.596 INFO:teuthology.orchestra.run.smithi172.stderr:INFO 2024-09-16 07:33:35,598 seastar - Reactor backend: linux-aio 2024-09-16T07:33:35.602 INFO:teuthology.orchestra.run.smithi172.stderr:==27785==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T07:33:35.709 INFO:teuthology.orchestra.run.smithi172.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x133cd1 0xdd332 0x4ab1c 0x5fe9be6 0x5fe9dfc 0x5fe9fdf 0x5fea2b5 0x60389b3 0x6038bb9 0x5fb8d06 0x5fb923a 0x5e00fef 0x5e19231 0x71579d2 0x71691a5 0x716a642 0x716a6c7 0x716a7c9 0x716a8c1 0x716aace 0x716acb4 0x716b003 0x716b3a7 0x716b5d7 0x716b841 0x716bb0e 0x716bd2c 0x716bde4 0x716beaa 0x716bf8b 0x5c63e30 0x5c63f3a 0x5c63ff6 0x5c640b2 0x5c6416e 0x5c642bb 0x5c64446 0x5c64807 0x5c7e60a 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3962bc0 0x396439a 0x3804c28 0x2958f 0x2963f 0x35ec9b4 2024-09-16T07:33:35.709 INFO:teuthology.orchestra.run.smithi172.stderr:kernel callstack: 2024-09-16T07:33:35.723 INFO:teuthology.orchestra.run.smithi172.stderr:INFO 2024-09-16 07:33:35,725 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-16T07:33:35.724 INFO:teuthology.orchestra.run.smithi172.stderr:INFO 2024-09-16 07:33:35,725 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 3-5 2024-09-16T07:33:35.724 INFO:teuthology.orchestra.run.smithi172.stderr:DEBUG 2024-09-16 07:33:35,726 [shard 0:main] seastar - reactor::drain 2024-09-16T07:33:36.238 INFO:teuthology.orchestra.run.smithi172.stderr:----------------------------------------------------- 2024-09-16T07:33:36.238 INFO:teuthology.orchestra.run.smithi172.stderr:Suppressions used: 2024-09-16T07:33:36.238 INFO:teuthology.orchestra.run.smithi172.stderr: count bytes template 2024-09-16T07:33:36.238 INFO:teuthology.orchestra.run.smithi172.stderr: 1 8 MallocExtension::Register 2024-09-16T07:33:36.238 INFO:teuthology.orchestra.run.smithi172.stderr:----------------------------------------------------- 2024-09-16T07:33:36.239 INFO:teuthology.orchestra.run.smithi172.stderr: 2024-09-16T07:33:36.294 INFO:teuthology.orchestra.run.smithi172.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T07:33:36.298 INFO:teuthology.orchestra.run.smithi172.stderr:INFO 2024-09-16 07:33:36,300 seastar - Reactor backend: linux-aio 2024-09-16T07:33:36.313 INFO:teuthology.orchestra.run.smithi172.stderr:==27783==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T07:33:41.011 INFO:teuthology.orchestra.run.smithi172.stderr:----------------------------------------------------- 2024-09-16T07:33:41.011 INFO:teuthology.orchestra.run.smithi172.stderr:Suppressions used: 2024-09-16T07:33:41.012 INFO:teuthology.orchestra.run.smithi172.stderr: count bytes template 2024-09-16T07:33:41.012 INFO:teuthology.orchestra.run.smithi172.stderr: 1 8 MallocExtension::Register 2024-09-16T07:33:41.012 INFO:teuthology.orchestra.run.smithi172.stderr:----------------------------------------------------- 2024-09-16T07:33:41.012 INFO:teuthology.orchestra.run.smithi172.stderr: 2024-09-16T07:33:41.034 DEBUG:teuthology.orchestra.run.smithi172:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-16T07:33:41.060 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-16T07:33:41.060 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-16T07:33:41.060 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-16T07:33:41.090 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-16T07:33:41.090 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-16T07:33:41.159 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-16T07:33:41.159 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-16T07:33:41.185 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-16T07:33:41.185 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-16T07:33:41.249 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-16T07:33:41.250 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-16T07:33:41.314 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-16T07:33:41.314 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-16T07:33:41.333 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-16T07:33:41.333 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-16T07:33:41.370 INFO:tasks.ceph:Adding keys to all mons... 2024-09-16T07:33:41.371 DEBUG:teuthology.orchestra.run.smithi121:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-16T07:33:41.401 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.0] 2024-09-16T07:33:41.401 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQA93+dmFSSZGBAA3mPKpcN4Z/+fu2M+NGpgJA== 2024-09-16T07:33:41.402 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.1] 2024-09-16T07:33:41.402 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQBD3+dmSJUqBxAAKcbH9CqFExX4CGIMLK7Q1g== 2024-09-16T07:33:41.402 INFO:teuthology.orchestra.run.smithi121.stdout:[mgr.x] 2024-09-16T07:33:41.402 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQA63+dmSPaFIxAAzXqv3ikEL4qKF1RKc3y9YQ== 2024-09-16T07:33:41.402 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.2] 2024-09-16T07:33:41.402 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQBK3+dmCHY0LBAAkTcM2WOOE/A6lhW2jo4gTA== 2024-09-16T07:33:41.402 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.3] 2024-09-16T07:33:41.402 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQBQ3+dmgIetGxAASEweDNGuUgz2BdZ34yZhVg== 2024-09-16T07:33:41.402 INFO:teuthology.orchestra.run.smithi121.stdout:[client.0] 2024-09-16T07:33:41.402 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQA63+dmE5TDJhAArTTqxUqxSO24+uQUg6tL5A== 2024-09-16T07:33:41.402 INFO:teuthology.orchestra.run.smithi121.stdout:[client.1] 2024-09-16T07:33:41.402 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQA63+dm0K+HKhAA35Soes5PpT62/KfgLimo1g== 2024-09-16T07:33:41.404 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T07:33:41.513 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T07:33:41.595 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-16T07:33:41.657 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T07:33:41.718 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T07:33:41.779 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-16T07:33:41.843 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-16T07:33:41.906 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-16T07:33:41.906 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-16T07:33:41.931 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-16T07:33:42.038 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.038+0000 7f21ef633c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:42.038 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.038+0000 7f21ef633c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:42.051 DEBUG:teuthology.orchestra.run.smithi121:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-16T07:33:42.076 DEBUG:teuthology.orchestra.run.smithi121:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-16T07:33:42.131 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-16T07:33:42.131 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-16T07:33:42.131 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-16T07:33:42.173 INFO:tasks.ceph.mon.a:Started 2024-09-16T07:33:42.174 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-16T07:33:42.174 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-16T07:33:42.174 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-16T07:33:42.177 INFO:tasks.ceph.mgr.x:Started 2024-09-16T07:33:42.177 DEBUG:tasks.ceph:set 0 configs 2024-09-16T07:33:42.177 INFO:tasks.ceph:Setting crush tunables to default 2024-09-16T07:33:42.177 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph osd crush tunables default 2024-09-16T07:33:42.253 INFO:tasks.ceph.mon.a.smithi121.stderr:2024-09-16T07:33:42.254+0000 7f1d86cd5c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:42.254 INFO:tasks.ceph.mon.a.smithi121.stderr:2024-09-16T07:33:42.254+0000 7f1d86cd5c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:42.254 INFO:tasks.ceph.mon.a.smithi121.stderr:2024-09-16T07:33:42.254+0000 7f1d86cd5c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:42.266 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-09-16T07:33:42.267+0000 7fb1edbdd000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:42.285 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.280+0000 7fa460191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:42.286 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.287+0000 7fa460191640 1 Processor -- start 2024-09-16T07:33:42.286 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.287+0000 7fa460191640 1 -- start start 2024-09-16T07:33:42.288 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.288+0000 7fa460191640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa45809d8c0 0x7fa458133ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:42.288 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.288+0000 7fa460191640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4580a2a30 con 0x7fa458134010 2024-09-16T07:33:42.288 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.288+0000 7fa460191640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fa45809fbe0 con 0x7fa45809d8c0 2024-09-16T07:33:42.288 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.289+0000 7fa45df2d640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa45809d8c0 0x7fa458133ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:42.289 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.289+0000 7fa45d72c640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fa458134010 0x7fa458132a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:48724/0 (socket says 172.21.15.121:48724) 2024-09-16T07:33:42.289 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.289+0000 7fa45df2d640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa45809d8c0 0x7fa458133ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:52494/0 (socket says 172.21.15.121:52494) 2024-09-16T07:33:42.289 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.289+0000 7fa45d72c640 1 -- 172.21.15.121:0/644491669 learned_addr learned my addr 172.21.15.121:0/644491669 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-16T07:33:42.289 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.289+0000 7fa45df2d640 1 -- 172.21.15.121:0/644491669 >> v1:172.21.15.121:6789/0 conn(0x7fa458134010 legacy=0x7fa458132a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:42.289 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.289+0000 7fa45df2d640 1 -- 172.21.15.121:0/644491669 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa45809e150 con 0x7fa45809d8c0 2024-09-16T07:33:42.290 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.290+0000 7fa45df2d640 1 --2- 172.21.15.121:0/644491669 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa45809d8c0 0x7fa458133ad0 crc :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=755cf3f97db8f340 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:42.290 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.290+0000 7fa45cf2b640 1 -- 172.21.15.121:0/644491669 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa454009d80 con 0x7fa45809d8c0 2024-09-16T07:33:42.291 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.290+0000 7fa45cf2b640 1 -- 172.21.15.121:0/644491669 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa45400e230 con 0x7fa45809d8c0 2024-09-16T07:33:42.291 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.290+0000 7fa45cf2b640 1 -- 172.21.15.121:0/644491669 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa45400e4d0 con 0x7fa45809d8c0 2024-09-16T07:33:42.291 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.291+0000 7fa460191640 1 -- 172.21.15.121:0/644491669 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa45809d8c0 msgr2=0x7fa458133ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:42.291 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.291+0000 7fa460191640 1 --2- 172.21.15.121:0/644491669 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa45809d8c0 0x7fa458133ad0 crc :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:42.291 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.291+0000 7fa460191640 1 -- 172.21.15.121:0/644491669 shutdown_connections 2024-09-16T07:33:42.291 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.291+0000 7fa460191640 1 --2- 172.21.15.121:0/644491669 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa45809d8c0 0x7fa458133ad0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:42.291 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.291+0000 7fa460191640 1 -- 172.21.15.121:0/644491669 >> 172.21.15.121:0/644491669 conn(0x7fa4580a2eb0 msgr2=0x7fa4580a32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:42.291 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.291+0000 7fa460191640 1 -- 172.21.15.121:0/644491669 shutdown_connections 2024-09-16T07:33:42.291 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.291+0000 7fa460191640 1 -- 172.21.15.121:0/644491669 wait complete. 2024-09-16T07:33:42.292 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.291+0000 7fa460191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:42.292 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.293+0000 7fa460191640 1 Processor -- start 2024-09-16T07:33:42.292 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.293+0000 7fa460191640 1 -- start start 2024-09-16T07:33:42.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.294+0000 7fa460191640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa45809d8c0 0x7fa458122a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:42.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.294+0000 7fa460191640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa458124d80 con 0x7fa45809d8c0 2024-09-16T07:33:42.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.294+0000 7fa45df2d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa45809d8c0 0x7fa458122a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:42.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.294+0000 7fa45df2d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa45809d8c0 0x7fa458122a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:52510/0 (socket says 172.21.15.121:52510) 2024-09-16T07:33:42.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.294+0000 7fa45df2d640 1 -- 172.21.15.121:0/1970364469 learned_addr learned my addr 172.21.15.121:0/1970364469 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:33:42.295 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.294+0000 7fa45df2d640 1 -- 172.21.15.121:0/1970364469 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa458133e00 con 0x7fa45809d8c0 2024-09-16T07:33:42.295 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.294+0000 7fa45df2d640 1 --2- 172.21.15.121:0/1970364469 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa45809d8c0 0x7fa458122a50 crc :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:42.295 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.294+0000 7fa44e7fc640 1 -- 172.21.15.121:0/1970364469 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa454014540 con 0x7fa45809d8c0 2024-09-16T07:33:42.295 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.294+0000 7fa44e7fc640 1 -- 172.21.15.121:0/1970364469 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa4540146a0 con 0x7fa45809d8c0 2024-09-16T07:33:42.295 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.294+0000 7fa460191640 1 -- 172.21.15.121:0/1970364469 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa458125d30 con 0x7fa45809d8c0 2024-09-16T07:33:42.295 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.294+0000 7fa44e7fc640 1 -- 172.21.15.121:0/1970364469 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa454014940 con 0x7fa45809d8c0 2024-09-16T07:33:42.295 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.294+0000 7fa460191640 1 -- 172.21.15.121:0/1970364469 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa458125a20 con 0x7fa45809d8c0 2024-09-16T07:33:42.295 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.294+0000 7fa44e7fc640 1 -- 172.21.15.121:0/1970364469 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7fa454013790 con 0x7fa45809d8c0 2024-09-16T07:33:42.295 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.295+0000 7fa44e7fc640 1 -- 172.21.15.121:0/1970364469 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (crc 0 0 0) 0x7fa454019040 con 0x7fa45809d8c0 2024-09-16T07:33:42.295 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.295+0000 7fa460191640 1 -- 172.21.15.121:0/1970364469 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa458126b00 con 0x7fa45809d8c0 2024-09-16T07:33:42.297 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.298+0000 7fa44e7fc640 1 -- 172.21.15.121:0/1970364469 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (crc 0 0 0) 0x7fa458133e00 con 0x7fa45809d8c0 2024-09-16T07:33:42.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.359+0000 7fa460191640 1 -- 172.21.15.121:0/1970364469 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fa458050fc0 con 0x7fa45809d8c0 2024-09-16T07:33:42.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.360+0000 7fa44e7fc640 1 -- 172.21.15.121:0/1970364469 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (crc 0 0 0) 0x7fa454012390 con 0x7fa45809d8c0 2024-09-16T07:33:42.359 INFO:teuthology.orchestra.run.smithi121.stderr:adjusted tunables profile to default 2024-09-16T07:33:42.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.361+0000 7fa460191640 1 -- 172.21.15.121:0/1970364469 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa45809d8c0 msgr2=0x7fa458122a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:42.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.361+0000 7fa460191640 1 --2- 172.21.15.121:0/1970364469 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa45809d8c0 0x7fa458122a50 crc :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:42.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.361+0000 7fa460191640 1 -- 172.21.15.121:0/1970364469 shutdown_connections 2024-09-16T07:33:42.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.361+0000 7fa460191640 1 --2- 172.21.15.121:0/1970364469 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa45809d8c0 0x7fa458122a50 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:42.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.361+0000 7fa460191640 1 -- 172.21.15.121:0/1970364469 >> 172.21.15.121:0/1970364469 conn(0x7fa4580a2eb0 msgr2=0x7fa458074a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:42.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.361+0000 7fa460191640 1 -- 172.21.15.121:0/1970364469 shutdown_connections 2024-09-16T07:33:42.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.361+0000 7fa460191640 1 -- 172.21.15.121:0/1970364469 wait complete. 2024-09-16T07:33:42.371 INFO:tasks.ceph:check_enable_crimson: True 2024-09-16T07:33:42.372 INFO:tasks.ceph:check_enable_crimson: setting set-allow-crimson 2024-09-16T07:33:42.372 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph osd set-allow-crimson --yes-i-really-mean-it 2024-09-16T07:33:42.471 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-09-16T07:33:42.472+0000 7fb1edbdd000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:42.471 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-09-16T07:33:42.472+0000 7fb1edbdd000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:42.477 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.473+0000 7ff254911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:42.478 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.479+0000 7ff254911640 1 Processor -- start 2024-09-16T07:33:42.478 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.479+0000 7ff254911640 1 -- start start 2024-09-16T07:33:42.480 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.480+0000 7ff254911640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff250131710 0x7ff2501392c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:42.480 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.480+0000 7ff254911640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff250130bb0 con 0x7ff2500a26d0 2024-09-16T07:33:42.480 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.480+0000 7ff254911640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7ff25009fb00 con 0x7ff250131710 2024-09-16T07:33:42.481 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.480+0000 7ff247fff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff250131710 0x7ff2501392c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:42.481 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.480+0000 7ff24e59c640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7ff2500a26d0 0x7ff250131000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:48730/0 (socket says 172.21.15.121:48730) 2024-09-16T07:33:42.481 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.480+0000 7ff247fff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff250131710 0x7ff2501392c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:52526/0 (socket says 172.21.15.121:52526) 2024-09-16T07:33:42.481 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.480+0000 7ff24e59c640 1 -- 172.21.15.121:0/4235684487 learned_addr learned my addr 172.21.15.121:0/4235684487 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-16T07:33:42.481 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.481+0000 7ff247fff640 1 -- 172.21.15.121:0/4235684487 >> v1:172.21.15.121:6789/0 conn(0x7ff2500a26d0 legacy=0x7ff250131000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:42.481 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.481+0000 7ff247fff640 1 -- 172.21.15.121:0/4235684487 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff25009fc40 con 0x7ff250131710 2024-09-16T07:33:42.481 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.481+0000 7ff24dd9b640 1 -- 172.21.15.121:0/4235684487 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2283031253 0 0) 0x7ff250130bb0 con 0x7ff2500a26d0 2024-09-16T07:33:42.481 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.481+0000 7ff247fff640 1 --2- 172.21.15.121:0/4235684487 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff250131710 0x7ff2501392c0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd43319b97d30104 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:42.481 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.481+0000 7ff24dd9b640 1 -- 172.21.15.121:0/4235684487 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff238009d90 con 0x7ff250131710 2024-09-16T07:33:42.481 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.481+0000 7ff24dd9b640 1 -- 172.21.15.121:0/4235684487 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff23800e230 con 0x7ff250131710 2024-09-16T07:33:42.481 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.481+0000 7ff24dd9b640 1 -- 172.21.15.121:0/4235684487 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff23800e4d0 con 0x7ff250131710 2024-09-16T07:33:42.482 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.482+0000 7ff254911640 1 -- 172.21.15.121:0/4235684487 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff250131710 msgr2=0x7ff2501392c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:42.483 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.482+0000 7ff254911640 1 --2- 172.21.15.121:0/4235684487 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff250131710 0x7ff2501392c0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:42.483 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.482+0000 7ff254911640 1 -- 172.21.15.121:0/4235684487 shutdown_connections 2024-09-16T07:33:42.483 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.482+0000 7ff254911640 1 --2- 172.21.15.121:0/4235684487 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff250131710 0x7ff2501392c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:42.483 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.482+0000 7ff254911640 1 -- 172.21.15.121:0/4235684487 >> 172.21.15.121:0/4235684487 conn(0x7ff2500a3310 msgr2=0x7ff2500a3720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:42.483 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.482+0000 7ff254911640 1 -- 172.21.15.121:0/4235684487 shutdown_connections 2024-09-16T07:33:42.483 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.482+0000 7ff254911640 1 -- 172.21.15.121:0/4235684487 wait complete. 2024-09-16T07:33:42.483 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.482+0000 7ff254911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:42.483 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.483+0000 7ff254911640 1 Processor -- start 2024-09-16T07:33:42.483 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.483+0000 7ff254911640 1 -- start start 2024-09-16T07:33:42.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.484+0000 7ff254911640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2500a26d0 0x7ff25012f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:42.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.484+0000 7ff254911640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff25011f0b0 con 0x7ff2500a26d0 2024-09-16T07:33:42.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.485+0000 7ff24e59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2500a26d0 0x7ff25012f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:42.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.485+0000 7ff24e59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2500a26d0 0x7ff25012f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:52538/0 (socket says 172.21.15.121:52538) 2024-09-16T07:33:42.486 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.485+0000 7ff24e59c640 1 -- 172.21.15.121:0/915802723 learned_addr learned my addr 172.21.15.121:0/915802723 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:33:42.486 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.485+0000 7ff24e59c640 1 -- 172.21.15.121:0/915802723 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff250075010 con 0x7ff2500a26d0 2024-09-16T07:33:42.486 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.485+0000 7ff24e59c640 1 --2- 172.21.15.121:0/915802723 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2500a26d0 0x7ff25012f600 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:42.486 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.485+0000 7ff246ffd640 1 -- 172.21.15.121:0/915802723 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff240004b80 con 0x7ff2500a26d0 2024-09-16T07:33:42.486 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.485+0000 7ff246ffd640 1 -- 172.21.15.121:0/915802723 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff240004ce0 con 0x7ff2500a26d0 2024-09-16T07:33:42.486 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.485+0000 7ff254911640 1 -- 172.21.15.121:0/915802723 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2500a5e20 con 0x7ff2500a26d0 2024-09-16T07:33:42.486 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.485+0000 7ff246ffd640 1 -- 172.21.15.121:0/915802723 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff240007120 con 0x7ff2500a26d0 2024-09-16T07:33:42.486 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.485+0000 7ff254911640 1 -- 172.21.15.121:0/915802723 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff25011cae0 con 0x7ff2500a26d0 2024-09-16T07:33:42.486 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.485+0000 7ff246ffd640 1 -- 172.21.15.121:0/915802723 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7ff24000c520 con 0x7ff2500a26d0 2024-09-16T07:33:42.486 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.485+0000 7ff246ffd640 1 -- 172.21.15.121:0/915802723 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (crc 0 0 0) 0x7ff24000fa20 con 0x7ff2500a26d0 2024-09-16T07:33:42.486 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.486+0000 7ff254911640 1 -- 172.21.15.121:0/915802723 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff250074de0 con 0x7ff2500a26d0 2024-09-16T07:33:42.487 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.488+0000 7ff246ffd640 1 -- 172.21.15.121:0/915802723 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (crc 0 0 0) 0x7ff250074de0 con 0x7ff2500a26d0 2024-09-16T07:33:42.559 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:42.560+0000 7ff254911640 1 -- 172.21.15.121:0/915802723 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd set-allow-crimson", "yes_i_really_mean_it": true} v 0) -- 0x7ff250131000 con 0x7ff2500a26d0 2024-09-16T07:33:42.559 INFO:tasks.ceph.mon.a.smithi121.stderr:2024-09-16T07:33:42.560+0000 7f1d7d9f4640 -1 WARNING: experimental feature 'crimson' is enabled 2024-09-16T07:33:42.560 INFO:tasks.ceph.mon.a.smithi121.stderr:Please be aware that this feature is experimental, untested, 2024-09-16T07:33:42.560 INFO:tasks.ceph.mon.a.smithi121.stderr:unsupported, and may result in data corruption, data loss, 2024-09-16T07:33:42.560 INFO:tasks.ceph.mon.a.smithi121.stderr:and/or irreparable damage to your cluster. Do not use 2024-09-16T07:33:42.560 INFO:tasks.ceph.mon.a.smithi121.stderr:feature with important data. 2024-09-16T07:33:42.560 INFO:tasks.ceph.mon.a.smithi121.stderr: 2024-09-16T07:33:43.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:43.361+0000 7ff246ffd640 1 -- 172.21.15.121:0/915802723 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd set-allow-crimson", "yes_i_really_mean_it": true}]=0 v3) ==== 99+0+0 (crc 0 0 0) 0x7ff2500a5e20 con 0x7ff2500a26d0 2024-09-16T07:33:43.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:43.362+0000 7ff254911640 1 -- 172.21.15.121:0/915802723 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2500a26d0 msgr2=0x7ff25012f600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:43.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:43.362+0000 7ff254911640 1 --2- 172.21.15.121:0/915802723 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2500a26d0 0x7ff25012f600 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:43.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:43.362+0000 7ff254911640 1 -- 172.21.15.121:0/915802723 shutdown_connections 2024-09-16T07:33:43.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:43.362+0000 7ff254911640 1 --2- 172.21.15.121:0/915802723 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2500a26d0 0x7ff25012f600 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:43.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:43.362+0000 7ff254911640 1 -- 172.21.15.121:0/915802723 >> 172.21.15.121:0/915802723 conn(0x7ff2500a3310 msgr2=0x7ff250135070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:43.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:43.362+0000 7ff254911640 1 -- 172.21.15.121:0/915802723 shutdown_connections 2024-09-16T07:33:43.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:43.362+0000 7ff254911640 1 -- 172.21.15.121:0/915802723 wait complete. 2024-09-16T07:33:43.374 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-16T07:33:43.374 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-16T07:33:43.374 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-16T07:33:43.401 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-16T07:33:43.402 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-16T07:33:43.469 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-16T07:33:43.469 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-16T07:33:43.494 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-16T07:33:43.494 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-16T07:33:43.560 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --cluster ceph osd new ff74ae4d-122c-4c59-9a69-b559f9f27a32 0 2024-09-16T07:33:43.708 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.703+0000 7f469fe97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:43.709 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.710+0000 7f469fe97640 1 Processor -- start 2024-09-16T07:33:43.709 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.710+0000 7f469fe97640 1 -- start start 2024-09-16T07:33:43.710 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.710+0000 7f469fe97640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f469811d970 0x7f469811fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:43.711 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.710+0000 7f469fe97640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46981204a0 con 0x7f469811acb0 2024-09-16T07:33:43.711 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.710+0000 7f469fe97640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f4698121660 con 0x7f469811d970 2024-09-16T07:33:43.711 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.711+0000 7f469d432640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f469811d970 0x7f469811fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:43.711 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.711+0000 7f469dc33640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f469811acb0 0x7f469811b0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.172:50242/0 (socket says 172.21.15.172:50242) 2024-09-16T07:33:43.711 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.711+0000 7f469d432640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f469811d970 0x7f469811fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.172:35710/0 (socket says 172.21.15.172:35710) 2024-09-16T07:33:43.711 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.711+0000 7f469dc33640 1 -- 172.21.15.172:0/2104516518 learned_addr learned my addr 172.21.15.172:0/2104516518 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-09-16T07:33:43.711 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.711+0000 7f469d432640 1 -- 172.21.15.172:0/2104516518 >> v1:172.21.15.121:6789/0 conn(0x7f469811acb0 legacy=0x7f469811b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:43.711 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.711+0000 7f469d432640 1 -- 172.21.15.172:0/2104516518 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46981217d0 con 0x7f469811d970 2024-09-16T07:33:43.711 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.711+0000 7f469cc31640 1 -- 172.21.15.172:0/2104516518 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3778351960 0 0) 0x7f46981204a0 con 0x7f469811acb0 2024-09-16T07:33:43.711 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.711+0000 7f469d432640 1 --2- 172.21.15.172:0/2104516518 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f469811d970 0x7f469811fdf0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f541b33183b992d server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:43.711 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.712+0000 7f469cc31640 1 -- 172.21.15.172:0/2104516518 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4694009d90 con 0x7f469811d970 2024-09-16T07:33:43.712 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.712+0000 7f469cc31640 1 -- 172.21.15.172:0/2104516518 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f469400e230 con 0x7f469811d970 2024-09-16T07:33:43.712 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.712+0000 7f469cc31640 1 -- 172.21.15.172:0/2104516518 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f469400e4d0 con 0x7f469811d970 2024-09-16T07:33:43.714 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.712+0000 7f469fe97640 1 -- 172.21.15.172:0/2104516518 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f469811d970 msgr2=0x7f469811fdf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:43.714 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.712+0000 7f469fe97640 1 --2- 172.21.15.172:0/2104516518 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f469811d970 0x7f469811fdf0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:43.714 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.712+0000 7f469fe97640 1 -- 172.21.15.172:0/2104516518 shutdown_connections 2024-09-16T07:33:43.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.712+0000 7f469fe97640 1 --2- 172.21.15.172:0/2104516518 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f469811d970 0x7f469811fdf0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:43.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.712+0000 7f469fe97640 1 -- 172.21.15.172:0/2104516518 >> 172.21.15.172:0/2104516518 conn(0x7f469806e9b0 msgr2=0x7f469806edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:43.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.712+0000 7f469fe97640 1 -- 172.21.15.172:0/2104516518 shutdown_connections 2024-09-16T07:33:43.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.712+0000 7f469fe97640 1 -- 172.21.15.172:0/2104516518 wait complete. 2024-09-16T07:33:43.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.713+0000 7f469fe97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:43.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.713+0000 7f469fe97640 1 Processor -- start 2024-09-16T07:33:43.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.713+0000 7f469fe97640 1 -- start start 2024-09-16T07:33:43.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.714+0000 7f469fe97640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f469811acb0 0x7f46981a9980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:43.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.714+0000 7f469fe97640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f46981a9f50 con 0x7f469811acb0 2024-09-16T07:33:43.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.714+0000 7f469dc33640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f469811acb0 0x7f46981a9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:43.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.714+0000 7f469dc33640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f469811acb0 0x7f46981a9980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.172:35716/0 (socket says 172.21.15.172:35716) 2024-09-16T07:33:43.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.714+0000 7f469dc33640 1 -- 172.21.15.172:0/3832906097 learned_addr learned my addr 172.21.15.172:0/3832906097 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-09-16T07:33:43.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.714+0000 7f469dc33640 1 -- 172.21.15.172:0/3832906097 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46981aa090 con 0x7f469811acb0 2024-09-16T07:33:43.716 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.715+0000 7f469dc33640 1 --2- 172.21.15.172:0/3832906097 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f469811acb0 0x7f46981a9980 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:43.716 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.715+0000 7f468a7fc640 1 -- 172.21.15.172:0/3832906097 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f468c004c60 con 0x7f469811acb0 2024-09-16T07:33:43.716 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.715+0000 7f468a7fc640 1 -- 172.21.15.172:0/3832906097 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f468c004dc0 con 0x7f469811acb0 2024-09-16T07:33:43.716 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.715+0000 7f469fe97640 1 -- 172.21.15.172:0/3832906097 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46981aa340 con 0x7f469811acb0 2024-09-16T07:33:43.716 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.715+0000 7f468a7fc640 1 -- 172.21.15.172:0/3832906097 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f468c007250 con 0x7f469811acb0 2024-09-16T07:33:43.716 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.715+0000 7f469fe97640 1 -- 172.21.15.172:0/3832906097 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46981af1e0 con 0x7f469811acb0 2024-09-16T07:33:43.716 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.715+0000 7f468a7fc640 1 -- 172.21.15.172:0/3832906097 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7f468c00c660 con 0x7f469811acb0 2024-09-16T07:33:43.716 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.715+0000 7f468a7fc640 1 -- 172.21.15.172:0/3832906097 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 747+0+0 (crc 0 0 0) 0x7f468c00fb70 con 0x7f469811acb0 2024-09-16T07:33:43.716 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.716+0000 7f469fe97640 1 -- 172.21.15.172:0/3832906097 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4698121110 con 0x7f469811acb0 2024-09-16T07:33:43.717 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.718+0000 7f468a7fc640 1 -- 172.21.15.172:0/3832906097 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (crc 0 0 0) 0x7f468c00fdd0 con 0x7f469811acb0 2024-09-16T07:33:43.787 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.788+0000 7f469fe97640 1 -- 172.21.15.172:0/3832906097 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ff74ae4d-122c-4c59-9a69-b559f9f27a32", "id": 0} v 0) -- 0x7f4698120990 con 0x7f469811acb0 2024-09-16T07:33:43.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.790+0000 7f468a7fc640 1 -- 172.21.15.172:0/3832906097 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ff74ae4d-122c-4c59-9a69-b559f9f27a32", "id": 0}]=0 v4) ==== 112+0+2 (crc 0 0 0) 0x7f468c00f230 con 0x7f469811acb0 2024-09-16T07:33:43.789 INFO:teuthology.orchestra.run.smithi172.stdout:0 2024-09-16T07:33:43.790 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.791+0000 7f469fe97640 1 -- 172.21.15.172:0/3832906097 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f469811acb0 msgr2=0x7f46981a9980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:43.790 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.791+0000 7f469fe97640 1 --2- 172.21.15.172:0/3832906097 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f469811acb0 0x7f46981a9980 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:43.790 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.791+0000 7f469fe97640 1 -- 172.21.15.172:0/3832906097 shutdown_connections 2024-09-16T07:33:43.790 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.791+0000 7f469fe97640 1 --2- 172.21.15.172:0/3832906097 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f469811acb0 0x7f46981a9980 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:43.790 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.791+0000 7f469fe97640 1 -- 172.21.15.172:0/3832906097 >> 172.21.15.172:0/3832906097 conn(0x7f469806e9b0 msgr2=0x7f469811dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:43.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.791+0000 7f469fe97640 1 -- 172.21.15.172:0/3832906097 shutdown_connections 2024-09-16T07:33:43.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.791+0000 7f469fe97640 1 -- 172.21.15.172:0/3832906097 wait complete. 2024-09-16T07:33:43.801 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --cluster ceph osd new 0d1cdc37-865f-43c6-af56-0ca5fb928e02 1 2024-09-16T07:33:43.909 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.904+0000 7f854de88640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:43.910 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.911+0000 7f854de88640 1 Processor -- start 2024-09-16T07:33:43.910 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.911+0000 7f854de88640 1 -- start start 2024-09-16T07:33:43.911 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.911+0000 7f854de88640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f8548119ac0 0x7f8548119ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:43.912 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.911+0000 7f854de88640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85481158e0 con 0x7f8548114dc0 2024-09-16T07:33:43.912 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.911+0000 7f854de88640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f8548115a70 con 0x7f8548119ac0 2024-09-16T07:33:43.912 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.912+0000 7f85477fe640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f8548119ac0 0x7f8548119ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:43.912 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.912+0000 7f8546ffd640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f8548114dc0 0x7f85481151d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.172:50250/0 (socket says 172.21.15.172:50250) 2024-09-16T07:33:43.912 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.912+0000 7f8546ffd640 1 -- 172.21.15.172:0/218938014 learned_addr learned my addr 172.21.15.172:0/218938014 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-09-16T07:33:43.912 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.912+0000 7f85477fe640 1 --2- 172.21.15.172:0/218938014 >> v2:172.21.15.121:3300/0 conn(0x7f8548119ac0 0x7f8548119ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.172:35724/0 (socket says 172.21.15.172:35724) 2024-09-16T07:33:43.912 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.912+0000 7f85477fe640 1 -- 172.21.15.172:0/218938014 >> v1:172.21.15.121:6789/0 conn(0x7f8548114dc0 legacy=0x7f85481151d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:43.913 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.912+0000 7f85477fe640 1 -- 172.21.15.172:0/218938014 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8548115be0 con 0x7f8548119ac0 2024-09-16T07:33:43.913 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.912+0000 7f85477fe640 1 --2- 172.21.15.172:0/218938014 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8548119ac0 0x7f8548119ed0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4df8fd9bf3c179ac server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:43.913 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.912+0000 7f85467fc640 1 -- 172.21.15.172:0/218938014 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8538009d90 con 0x7f8548119ac0 2024-09-16T07:33:43.913 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.912+0000 7f85467fc640 1 -- 172.21.15.172:0/218938014 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f853800e230 con 0x7f8548119ac0 2024-09-16T07:33:43.913 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.912+0000 7f85467fc640 1 -- 172.21.15.172:0/218938014 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f853800e4d0 con 0x7f8548119ac0 2024-09-16T07:33:43.915 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.913+0000 7f854de88640 1 -- 172.21.15.172:0/218938014 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8548119ac0 msgr2=0x7f8548119ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:43.916 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.913+0000 7f854de88640 1 --2- 172.21.15.172:0/218938014 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8548119ac0 0x7f8548119ed0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:43.916 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.913+0000 7f854de88640 1 -- 172.21.15.172:0/218938014 shutdown_connections 2024-09-16T07:33:43.916 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.913+0000 7f854de88640 1 --2- 172.21.15.172:0/218938014 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8548119ac0 0x7f8548119ed0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:43.916 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.913+0000 7f854de88640 1 -- 172.21.15.172:0/218938014 >> 172.21.15.172:0/218938014 conn(0x7f854806ea40 msgr2=0x7f854806ee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:43.916 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.913+0000 7f854de88640 1 -- 172.21.15.172:0/218938014 shutdown_connections 2024-09-16T07:33:43.916 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.913+0000 7f854de88640 1 -- 172.21.15.172:0/218938014 wait complete. 2024-09-16T07:33:43.916 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.913+0000 7f854de88640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:43.916 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.914+0000 7f854de88640 1 Processor -- start 2024-09-16T07:33:43.916 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.914+0000 7f854de88640 1 -- start start 2024-09-16T07:33:43.916 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.914+0000 7f854de88640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8548114dc0 0x7f85481a9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:43.916 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.914+0000 7f854de88640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f85481aa070 con 0x7f8548114dc0 2024-09-16T07:33:43.916 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.915+0000 7f85477fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8548114dc0 0x7f85481a9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:43.917 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.915+0000 7f85477fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8548114dc0 0x7f85481a9aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.172:35732/0 (socket says 172.21.15.172:35732) 2024-09-16T07:33:43.917 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.915+0000 7f85477fe640 1 -- 172.21.15.172:0/210453517 learned_addr learned my addr 172.21.15.172:0/210453517 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-09-16T07:33:43.917 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.915+0000 7f85477fe640 1 -- 172.21.15.172:0/210453517 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85481aa1b0 con 0x7f8548114dc0 2024-09-16T07:33:43.917 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.915+0000 7f85477fe640 1 --2- 172.21.15.172:0/210453517 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8548114dc0 0x7f85481a9aa0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:43.917 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.915+0000 7f852ffff640 1 -- 172.21.15.172:0/210453517 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8538014620 con 0x7f8548114dc0 2024-09-16T07:33:43.917 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.915+0000 7f852ffff640 1 -- 172.21.15.172:0/210453517 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f8538014780 con 0x7f8548114dc0 2024-09-16T07:33:43.917 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.915+0000 7f854de88640 1 -- 172.21.15.172:0/210453517 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85481aa400 con 0x7f8548114dc0 2024-09-16T07:33:43.917 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.915+0000 7f852ffff640 1 -- 172.21.15.172:0/210453517 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8538014a20 con 0x7f8548114dc0 2024-09-16T07:33:43.917 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.915+0000 7f854de88640 1 -- 172.21.15.172:0/210453517 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85481af300 con 0x7f8548114dc0 2024-09-16T07:33:43.917 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.916+0000 7f852ffff640 1 -- 172.21.15.172:0/210453517 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7f8538013400 con 0x7f8548114dc0 2024-09-16T07:33:43.917 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.916+0000 7f852ffff640 1 -- 172.21.15.172:0/210453517 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 862+0+0 (crc 0 0 0) 0x7f8538019040 con 0x7f8548114dc0 2024-09-16T07:33:43.917 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.916+0000 7f854de88640 1 -- 172.21.15.172:0/210453517 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8548120cc0 con 0x7f8548114dc0 2024-09-16T07:33:43.918 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:43.919+0000 7f852ffff640 1 -- 172.21.15.172:0/210453517 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (crc 0 0 0) 0x7f8538013890 con 0x7f8548114dc0 2024-09-16T07:33:44.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.002+0000 7f854de88640 1 -- 172.21.15.172:0/210453517 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0d1cdc37-865f-43c6-af56-0ca5fb928e02", "id": 1} v 0) -- 0x7f8548120ea0 con 0x7f8548114dc0 2024-09-16T07:33:44.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.003+0000 7f852ffff640 1 -- 172.21.15.172:0/210453517 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0d1cdc37-865f-43c6-af56-0ca5fb928e02", "id": 1}]=0 v5) ==== 112+0+2 (crc 0 0 0) 0x7f8538013b00 con 0x7f8548114dc0 2024-09-16T07:33:44.002 INFO:teuthology.orchestra.run.smithi172.stdout:1 2024-09-16T07:33:44.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.004+0000 7f854de88640 1 -- 172.21.15.172:0/210453517 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8548114dc0 msgr2=0x7f85481a9aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:44.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.004+0000 7f854de88640 1 --2- 172.21.15.172:0/210453517 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8548114dc0 0x7f85481a9aa0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:44.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.004+0000 7f854de88640 1 -- 172.21.15.172:0/210453517 shutdown_connections 2024-09-16T07:33:44.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.005+0000 7f854de88640 1 --2- 172.21.15.172:0/210453517 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8548114dc0 0x7f85481a9aa0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:44.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.005+0000 7f854de88640 1 -- 172.21.15.172:0/210453517 >> 172.21.15.172:0/210453517 conn(0x7f854806ea40 msgr2=0x7f85481186d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:44.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.005+0000 7f854de88640 1 -- 172.21.15.172:0/210453517 shutdown_connections 2024-09-16T07:33:44.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.005+0000 7f854de88640 1 -- 172.21.15.172:0/210453517 wait complete. 2024-09-16T07:33:44.018 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --cluster ceph osd new 429c0781-5021-41da-8e0e-985110dcea52 2 2024-09-16T07:33:44.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.121+0000 7fafc5884640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:44.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.127+0000 7fafc5884640 1 Processor -- start 2024-09-16T07:33:44.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.127+0000 7fafc5884640 1 -- start start 2024-09-16T07:33:44.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.128+0000 7fafc5884640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fafc011acb0 0x7fafc011b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:44.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.128+0000 7fafc5884640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafc01158e0 con 0x7fafc0114dc0 2024-09-16T07:33:44.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.128+0000 7fafc5884640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fafc0115a70 con 0x7fafc011acb0 2024-09-16T07:33:44.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.128+0000 7fafbeffd640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fafc011acb0 0x7fafc011b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:44.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.128+0000 7fafbe7fc640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fafc0114dc0 0x7fafc01151d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.172:50262/0 (socket says 172.21.15.172:50262) 2024-09-16T07:33:44.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.128+0000 7fafbeffd640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fafc011acb0 0x7fafc011b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.172:35738/0 (socket says 172.21.15.172:35738) 2024-09-16T07:33:44.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.128+0000 7fafbe7fc640 1 -- 172.21.15.172:0/3921064913 learned_addr learned my addr 172.21.15.172:0/3921064913 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-09-16T07:33:44.130 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.129+0000 7fafbdffb640 1 -- 172.21.15.172:0/3921064913 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 133524441 0 0) 0x7fafc01158e0 con 0x7fafc0114dc0 2024-09-16T07:33:44.130 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.129+0000 7fafbdffb640 1 -- 172.21.15.172:0/3921064913 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fafac003580 con 0x7fafc0114dc0 2024-09-16T07:33:44.130 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.129+0000 7fafbeffd640 1 -- 172.21.15.172:0/3921064913 >> v1:172.21.15.121:6789/0 conn(0x7fafc0114dc0 legacy=0x7fafc01151d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:44.130 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.129+0000 7fafbeffd640 1 -- 172.21.15.172:0/3921064913 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafc0115be0 con 0x7fafc011acb0 2024-09-16T07:33:44.130 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.129+0000 7fafbeffd640 1 --2- 172.21.15.172:0/3921064913 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fafc011acb0 0x7fafc011b0c0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28fd2150e138c1c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:44.130 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.129+0000 7fafbdffb640 1 -- 172.21.15.172:0/3921064913 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fafb8009d90 con 0x7fafc011acb0 2024-09-16T07:33:44.130 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.129+0000 7fafbdffb640 1 -- 172.21.15.172:0/3921064913 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fafb800e230 con 0x7fafc011acb0 2024-09-16T07:33:44.130 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.129+0000 7fafbdffb640 1 -- 172.21.15.172:0/3921064913 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fafb800e4d0 con 0x7fafc011acb0 2024-09-16T07:33:44.130 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.130+0000 7fafc5884640 1 -- 172.21.15.172:0/3921064913 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fafc011acb0 msgr2=0x7fafc011b0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:44.130 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.130+0000 7fafc5884640 1 --2- 172.21.15.172:0/3921064913 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fafc011acb0 0x7fafc011b0c0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:44.130 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.130+0000 7fafc5884640 1 -- 172.21.15.172:0/3921064913 shutdown_connections 2024-09-16T07:33:44.130 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.130+0000 7fafc5884640 1 --2- 172.21.15.172:0/3921064913 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fafc011acb0 0x7fafc011b0c0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:44.130 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.130+0000 7fafc5884640 1 -- 172.21.15.172:0/3921064913 >> 172.21.15.172:0/3921064913 conn(0x7fafc006e9b0 msgr2=0x7fafc006edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:44.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.130+0000 7fafc5884640 1 -- 172.21.15.172:0/3921064913 shutdown_connections 2024-09-16T07:33:44.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.130+0000 7fafc5884640 1 -- 172.21.15.172:0/3921064913 wait complete. 2024-09-16T07:33:44.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.130+0000 7fafc5884640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:44.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.131+0000 7fafc5884640 1 Processor -- start 2024-09-16T07:33:44.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.131+0000 7fafc5884640 1 -- start start 2024-09-16T07:33:44.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.131+0000 7fafc5884640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fafc0114dc0 0x7fafc01a9900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:44.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.131+0000 7fafc5884640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fafc01a9ed0 con 0x7fafc0114dc0 2024-09-16T07:33:44.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.132+0000 7fafbeffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fafc0114dc0 0x7fafc01a9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:44.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.132+0000 7fafbeffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fafc0114dc0 0x7fafc01a9900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.172:35754/0 (socket says 172.21.15.172:35754) 2024-09-16T07:33:44.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.132+0000 7fafbeffd640 1 -- 172.21.15.172:0/1434924878 learned_addr learned my addr 172.21.15.172:0/1434924878 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-09-16T07:33:44.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.132+0000 7fafbeffd640 1 -- 172.21.15.172:0/1434924878 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafc01aa010 con 0x7fafc0114dc0 2024-09-16T07:33:44.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.132+0000 7fafbeffd640 1 --2- 172.21.15.172:0/1434924878 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fafc0114dc0 0x7fafc01a9900 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:44.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.132+0000 7fafb7fff640 1 -- 172.21.15.172:0/1434924878 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fafb8014410 con 0x7fafc0114dc0 2024-09-16T07:33:44.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.132+0000 7fafb7fff640 1 -- 172.21.15.172:0/1434924878 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fafb8014570 con 0x7fafc0114dc0 2024-09-16T07:33:44.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.132+0000 7fafc5884640 1 -- 172.21.15.172:0/1434924878 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafc01aa260 con 0x7fafc0114dc0 2024-09-16T07:33:44.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.132+0000 7fafb7fff640 1 -- 172.21.15.172:0/1434924878 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fafb8014810 con 0x7fafc0114dc0 2024-09-16T07:33:44.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.132+0000 7fafc5884640 1 -- 172.21.15.172:0/1434924878 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafc01af1e0 con 0x7fafc0114dc0 2024-09-16T07:33:44.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.133+0000 7fafb7fff640 1 -- 172.21.15.172:0/1434924878 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7fafb8013400 con 0x7fafc0114dc0 2024-09-16T07:33:44.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.133+0000 7fafb7fff640 1 -- 172.21.15.172:0/1434924878 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 977+0+0 (crc 0 0 0) 0x7fafb8019040 con 0x7fafc0114dc0 2024-09-16T07:33:44.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.133+0000 7fafc5884640 1 -- 172.21.15.172:0/1434924878 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafc0120cf0 con 0x7fafc0114dc0 2024-09-16T07:33:44.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.136+0000 7fafb7fff640 1 -- 172.21.15.172:0/1434924878 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (crc 0 0 0) 0x7fafb80116f0 con 0x7fafc0114dc0 2024-09-16T07:33:44.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.207+0000 7fafc5884640 1 -- 172.21.15.172:0/1434924878 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd new", "uuid": "429c0781-5021-41da-8e0e-985110dcea52", "id": 2} v 0) -- 0x7fafc0120e80 con 0x7fafc0114dc0 2024-09-16T07:33:44.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.209+0000 7fafb7fff640 1 -- 172.21.15.172:0/1434924878 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "429c0781-5021-41da-8e0e-985110dcea52", "id": 2}]=0 v6) ==== 112+0+2 (crc 0 0 0) 0x7fafb80059f0 con 0x7fafc0114dc0 2024-09-16T07:33:44.208 INFO:teuthology.orchestra.run.smithi172.stdout:2 2024-09-16T07:33:44.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.210+0000 7fafc5884640 1 -- 172.21.15.172:0/1434924878 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fafc0114dc0 msgr2=0x7fafc01a9900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:44.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.210+0000 7fafc5884640 1 --2- 172.21.15.172:0/1434924878 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fafc0114dc0 0x7fafc01a9900 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:44.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.210+0000 7fafc5884640 1 -- 172.21.15.172:0/1434924878 shutdown_connections 2024-09-16T07:33:44.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.210+0000 7fafc5884640 1 --2- 172.21.15.172:0/1434924878 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fafc0114dc0 0x7fafc01a9900 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:44.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.210+0000 7fafc5884640 1 -- 172.21.15.172:0/1434924878 >> 172.21.15.172:0/1434924878 conn(0x7fafc006e9b0 msgr2=0x7fafc0113db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:44.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.210+0000 7fafc5884640 1 -- 172.21.15.172:0/1434924878 shutdown_connections 2024-09-16T07:33:44.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.210+0000 7fafc5884640 1 -- 172.21.15.172:0/1434924878 wait complete. 2024-09-16T07:33:44.220 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --cluster ceph osd new 0ea1bce1-3795-403b-af2f-e62972443062 3 2024-09-16T07:33:44.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.323+0000 7f890fd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:44.329 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.329+0000 7f890fd91640 1 Processor -- start 2024-09-16T07:33:44.329 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.330+0000 7f890fd91640 1 -- start start 2024-09-16T07:33:44.329 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.330+0000 7f890fd91640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f890811acb0 0x7f890811b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:44.329 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.330+0000 7f890fd91640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89081158e0 con 0x7f8908114dc0 2024-09-16T07:33:44.329 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.330+0000 7f890fd91640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f8908115a70 con 0x7f890811acb0 2024-09-16T07:33:44.330 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.330+0000 7f890db2d640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f890811acb0 0x7f890811b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:44.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.331+0000 7f890d32c640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f8908114dc0 0x7f89081151d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.172:50276/0 (socket says 172.21.15.172:50276) 2024-09-16T07:33:44.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.331+0000 7f890db2d640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f890811acb0 0x7f890811b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.172:35764/0 (socket says 172.21.15.172:35764) 2024-09-16T07:33:44.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.331+0000 7f890d32c640 1 -- 172.21.15.172:0/1408391243 learned_addr learned my addr 172.21.15.172:0/1408391243 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-09-16T07:33:44.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.331+0000 7f890db2d640 1 -- 172.21.15.172:0/1408391243 >> v1:172.21.15.121:6789/0 conn(0x7f8908114dc0 legacy=0x7f89081151d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:44.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.331+0000 7f890db2d640 1 -- 172.21.15.172:0/1408391243 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8908115be0 con 0x7f890811acb0 2024-09-16T07:33:44.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.331+0000 7f890db2d640 1 --2- 172.21.15.172:0/1408391243 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f890811acb0 0x7f890811b0c0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10834599f2903f1b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:44.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.331+0000 7f890cb2b640 1 -- 172.21.15.172:0/1408391243 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8904009d90 con 0x7f890811acb0 2024-09-16T07:33:44.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.331+0000 7f890cb2b640 1 -- 172.21.15.172:0/1408391243 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f890400e230 con 0x7f890811acb0 2024-09-16T07:33:44.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.331+0000 7f890cb2b640 1 -- 172.21.15.172:0/1408391243 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f890400e4d0 con 0x7f890811acb0 2024-09-16T07:33:44.333 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.332+0000 7f890fd91640 1 -- 172.21.15.172:0/1408391243 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f890811acb0 msgr2=0x7f890811b0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:44.334 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.332+0000 7f890fd91640 1 --2- 172.21.15.172:0/1408391243 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f890811acb0 0x7f890811b0c0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:44.334 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.332+0000 7f890fd91640 1 -- 172.21.15.172:0/1408391243 shutdown_connections 2024-09-16T07:33:44.334 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.332+0000 7f890fd91640 1 --2- 172.21.15.172:0/1408391243 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f890811acb0 0x7f890811b0c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:44.334 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.332+0000 7f890fd91640 1 -- 172.21.15.172:0/1408391243 >> 172.21.15.172:0/1408391243 conn(0x7f890806e9b0 msgr2=0x7f890806edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:44.334 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.332+0000 7f890fd91640 1 -- 172.21.15.172:0/1408391243 shutdown_connections 2024-09-16T07:33:44.334 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.332+0000 7f890fd91640 1 -- 172.21.15.172:0/1408391243 wait complete. 2024-09-16T07:33:44.334 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.332+0000 7f890fd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:44.334 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.333+0000 7f890fd91640 1 Processor -- start 2024-09-16T07:33:44.334 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.333+0000 7f890fd91640 1 -- start start 2024-09-16T07:33:44.334 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.333+0000 7f890fd91640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8908114dc0 0x7f89081a9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:44.334 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.333+0000 7f890fd91640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f89081aa090 con 0x7f8908114dc0 2024-09-16T07:33:44.334 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.334+0000 7f890db2d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8908114dc0 0x7f89081a9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:44.335 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.334+0000 7f890db2d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8908114dc0 0x7f89081a9ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.172:35776/0 (socket says 172.21.15.172:35776) 2024-09-16T07:33:44.335 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.334+0000 7f890db2d640 1 -- 172.21.15.172:0/928717307 learned_addr learned my addr 172.21.15.172:0/928717307 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-09-16T07:33:44.335 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.334+0000 7f890db2d640 1 -- 172.21.15.172:0/928717307 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89081aa1d0 con 0x7f8908114dc0 2024-09-16T07:33:44.335 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.334+0000 7f890db2d640 1 --2- 172.21.15.172:0/928717307 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8908114dc0 0x7f89081a9ac0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:44.335 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.334+0000 7f88fe7fc640 1 -- 172.21.15.172:0/928717307 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8904014620 con 0x7f8908114dc0 2024-09-16T07:33:44.335 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.334+0000 7f88fe7fc640 1 -- 172.21.15.172:0/928717307 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f8904014780 con 0x7f8908114dc0 2024-09-16T07:33:44.335 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.334+0000 7f890fd91640 1 -- 172.21.15.172:0/928717307 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89081aa420 con 0x7f8908114dc0 2024-09-16T07:33:44.335 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.334+0000 7f88fe7fc640 1 -- 172.21.15.172:0/928717307 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8904014a20 con 0x7f8908114dc0 2024-09-16T07:33:44.335 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.335+0000 7f890fd91640 1 -- 172.21.15.172:0/928717307 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89081af3a0 con 0x7f8908114dc0 2024-09-16T07:33:44.335 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.335+0000 7f88fe7fc640 1 -- 172.21.15.172:0/928717307 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7f8904013400 con 0x7f8908114dc0 2024-09-16T07:33:44.335 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.335+0000 7f88fe7fc640 1 -- 172.21.15.172:0/928717307 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1092+0+0 (crc 0 0 0) 0x7f8904019040 con 0x7f8908114dc0 2024-09-16T07:33:44.336 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.335+0000 7f890fd91640 1 -- 172.21.15.172:0/928717307 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8908120cf0 con 0x7f8908114dc0 2024-09-16T07:33:44.337 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.338+0000 7f88fe7fc640 1 -- 172.21.15.172:0/928717307 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (crc 0 0 0) 0x7f89040126b0 con 0x7f8908114dc0 2024-09-16T07:33:44.408 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.409+0000 7f890fd91640 1 -- 172.21.15.172:0/928717307 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0ea1bce1-3795-403b-af2f-e62972443062", "id": 3} v 0) -- 0x7f8908120ed0 con 0x7f8908114dc0 2024-09-16T07:33:44.409 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.411+0000 7f88fe7fc640 1 -- 172.21.15.172:0/928717307 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0ea1bce1-3795-403b-af2f-e62972443062", "id": 3}]=0 v7) ==== 112+0+2 (crc 0 0 0) 0x7f89040129a0 con 0x7f8908114dc0 2024-09-16T07:33:44.410 INFO:teuthology.orchestra.run.smithi172.stdout:3 2024-09-16T07:33:44.411 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.411+0000 7f890fd91640 1 -- 172.21.15.172:0/928717307 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8908114dc0 msgr2=0x7f89081a9ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:44.411 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.411+0000 7f890fd91640 1 --2- 172.21.15.172:0/928717307 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8908114dc0 0x7f89081a9ac0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:44.411 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.412+0000 7f890fd91640 1 -- 172.21.15.172:0/928717307 shutdown_connections 2024-09-16T07:33:44.411 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.412+0000 7f890fd91640 1 --2- 172.21.15.172:0/928717307 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8908114dc0 0x7f89081a9ac0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:44.411 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.412+0000 7f890fd91640 1 -- 172.21.15.172:0/928717307 >> 172.21.15.172:0/928717307 conn(0x7f890806e9b0 msgr2=0x7f8908113db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:44.411 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.412+0000 7f890fd91640 1 -- 172.21.15.172:0/928717307 shutdown_connections 2024-09-16T07:33:44.411 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-16T07:33:44.412+0000 7f890fd91640 1 -- 172.21.15.172:0/928717307 wait complete. 2024-09-16T07:33:44.421 DEBUG:teuthology.orchestra.run.smithi121:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.0.log 2024-09-16T07:33:44.455 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-16T07:33:44.456 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log 2024-09-16T07:33:44.498 INFO:tasks.ceph.osd.0:Started 2024-09-16T07:33:44.498 DEBUG:teuthology.orchestra.run.smithi121:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.1.log 2024-09-16T07:33:44.530 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-16T07:33:44.530 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2>> /var/log/ceph/ceph-osd.1.log 2024-09-16T07:33:44.572 INFO:tasks.ceph.osd.1:Started 2024-09-16T07:33:44.572 DEBUG:teuthology.orchestra.run.smithi172:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.2.log 2024-09-16T07:33:44.602 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-16T07:33:44.602 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2>> /var/log/ceph/ceph-osd.2.log 2024-09-16T07:33:44.645 INFO:tasks.ceph.osd.2:Started 2024-09-16T07:33:44.645 DEBUG:teuthology.orchestra.run.smithi172:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.3.log 2024-09-16T07:33:44.674 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-16T07:33:44.674 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2>> /var/log/ceph/ceph-osd.3.log 2024-09-16T07:33:44.716 INFO:tasks.ceph.osd.3:Started 2024-09-16T07:33:44.717 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:33:44.830 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:44.827+0000 7ff18e791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:44.831 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:44.832+0000 7ff18e791640 1 Processor -- start 2024-09-16T07:33:44.831 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:44.832+0000 7ff18e791640 1 -- start start 2024-09-16T07:33:44.834 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:44.833+0000 7ff18e791640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff18809d570 0x7ff18813b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:44.834 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:44.833+0000 7ff18e791640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1880a0060 con 0x7ff18809ca50 2024-09-16T07:33:44.835 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:44.833+0000 7ff18e791640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7ff18809fd30 con 0x7ff18809d570 2024-09-16T07:33:44.835 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:44.834+0000 7ff17ffff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff18809d570 0x7ff18813b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:44.835 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:44.834+0000 7ff187fff640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7ff18809ca50 0x7ff18809ce60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:44710/0 (socket says 172.21.15.121:44710) 2024-09-16T07:33:44.835 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:44.834+0000 7ff187fff640 1 -- 172.21.15.121:0/2563602807 learned_addr learned my addr 172.21.15.121:0/2563602807 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-16T07:33:44.835 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:44.834+0000 7ff17ffff640 1 -- 172.21.15.121:0/2563602807 >> v1:172.21.15.121:6789/0 conn(0x7ff18809ca50 legacy=0x7ff18809ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:44.835 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:44.834+0000 7ff17ffff640 1 -- 172.21.15.121:0/2563602807 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff18809e3c0 con 0x7ff18809d570 2024-09-16T07:33:44.835 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:44.834+0000 7ff17ffff640 1 --2- 172.21.15.121:0/2563602807 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff18809d570 0x7ff18813b3b0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23d63be5fc94aa8b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:44.835 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:44.834+0000 7ff1877fe640 1 -- 172.21.15.121:0/2563602807 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff170009d80 con 0x7ff18809d570 2024-09-16T07:33:44.835 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:44.834+0000 7ff1877fe640 1 -- 172.21.15.121:0/2563602807 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff17000e230 con 0x7ff18809d570 2024-09-16T07:33:44.835 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:44.834+0000 7ff1877fe640 1 -- 172.21.15.121:0/2563602807 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff17000e4d0 con 0x7ff18809d570 2024-09-16T07:33:44.836 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:44.835+0000 7ff18e791640 1 -- 172.21.15.121:0/2563602807 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff18809d570 msgr2=0x7ff18813b3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:44.836 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:44.835+0000 7ff18e791640 1 --2- 172.21.15.121:0/2563602807 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff18809d570 0x7ff18813b3b0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:44.836 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:44.835+0000 7ff18e791640 1 -- 172.21.15.121:0/2563602807 shutdown_connections 2024-09-16T07:33:44.836 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:44.835+0000 7ff18e791640 1 --2- 172.21.15.121:0/2563602807 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff18809d570 0x7ff18813b3b0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:44.836 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:44.835+0000 7ff18e791640 1 -- 172.21.15.121:0/2563602807 >> 172.21.15.121:0/2563602807 conn(0x7ff1880a5230 msgr2=0x7ff1880a5640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:44.836 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:44.835+0000 7ff18e791640 1 -- 172.21.15.121:0/2563602807 shutdown_connections 2024-09-16T07:33:44.837 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:44.835+0000 7ff18e791640 1 -- 172.21.15.121:0/2563602807 wait complete. 2024-09-16T07:33:44.837 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:44.835+0000 7ff18e791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:44.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:44.837+0000 7ff18e791640 1 Processor -- start 2024-09-16T07:33:44.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:44.837+0000 7ff18e791640 1 -- start start 2024-09-16T07:33:44.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:44.838+0000 7ff18e791640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff18809ca50 0x7ff188122dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:44.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:44.838+0000 7ff18e791640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff188124260 con 0x7ff18809ca50 2024-09-16T07:33:44.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:44.838+0000 7ff187fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff18809ca50 0x7ff188122dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:44.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:44.838+0000 7ff187fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff18809ca50 0x7ff188122dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60346/0 (socket says 172.21.15.121:60346) 2024-09-16T07:33:44.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:44.838+0000 7ff187fff640 1 -- 172.21.15.121:0/3498780759 learned_addr learned my addr 172.21.15.121:0/3498780759 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:33:44.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:44.838+0000 7ff187fff640 1 -- 172.21.15.121:0/3498780759 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff188126cf0 con 0x7ff18809ca50 2024-09-16T07:33:44.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:44.838+0000 7ff187fff640 1 --2- 172.21.15.121:0/3498780759 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff18809ca50 0x7ff188122dc0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:44.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:44.838+0000 7ff1857fa640 1 -- 172.21.15.121:0/3498780759 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff178005a60 con 0x7ff18809ca50 2024-09-16T07:33:44.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:44.838+0000 7ff1857fa640 1 -- 172.21.15.121:0/3498780759 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff178005bc0 con 0x7ff18809ca50 2024-09-16T07:33:44.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:44.838+0000 7ff18e791640 1 -- 172.21.15.121:0/3498780759 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1881269c0 con 0x7ff18809ca50 2024-09-16T07:33:44.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:44.838+0000 7ff1857fa640 1 -- 172.21.15.121:0/3498780759 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff178005e60 con 0x7ff18809ca50 2024-09-16T07:33:44.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:44.839+0000 7ff18e791640 1 -- 172.21.15.121:0/3498780759 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff188126620 con 0x7ff18809ca50 2024-09-16T07:33:44.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:44.839+0000 7ff1857fa640 1 -- 172.21.15.121:0/3498780759 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7ff178007440 con 0x7ff18809ca50 2024-09-16T07:33:44.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:44.839+0000 7ff1857fa640 1 -- 172.21.15.121:0/3498780759 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1207+0+0 (crc 0 0 0) 0x7ff17800fb10 con 0x7ff18809ca50 2024-09-16T07:33:44.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:44.839+0000 7ff18e791640 1 -- 172.21.15.121:0/3498780759 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff188125120 con 0x7ff18809ca50 2024-09-16T07:33:44.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:44.844+0000 7ff1857fa640 1 -- 172.21.15.121:0/3498780759 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (crc 0 0 0) 0x7ff17800fd70 con 0x7ff18809ca50 2024-09-16T07:33:44.918 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:44.919+0000 7ff18e791640 1 -- 172.21.15.121:0/3498780759 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff18809ce60 con 0x7ff18809ca50 2024-09-16T07:33:44.918 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:44.919+0000 7ff1857fa640 1 -- 172.21.15.121:0/3498780759 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v7) ==== 74+0+4152 (crc 0 0 0) 0x7ff17800f5f0 con 0x7ff18809ca50 2024-09-16T07:33:44.919 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:33:44.919 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":7,"fsid":"5b0c4070-0374-47d9-9f2a-f525ac27c89c","created":"2024-09-16T07:33:42.277188+0000","modified":"2024-09-16T07:33:44.410434+0000","last_up_change":"0.000000","last_in_change":"2024-09-16T07:33:44.410434+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"ff74ae4d-122c-4c59-9a69-b559f9f27a32","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"0d1cdc37-865f-43c6-af56-0ca5fb928e02","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"429c0781-5021-41da-8e0e-985110dcea52","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"0ea1bce1-3795-403b-af2f-e62972443062","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:33:44.920 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:44.920+0000 7ff18e791640 1 -- 172.21.15.121:0/3498780759 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff18809ca50 msgr2=0x7ff188122dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:44.920 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:44.920+0000 7ff18e791640 1 --2- 172.21.15.121:0/3498780759 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff18809ca50 0x7ff188122dc0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:44.920 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:44.920+0000 7ff18e791640 1 -- 172.21.15.121:0/3498780759 shutdown_connections 2024-09-16T07:33:44.920 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:44.920+0000 7ff18e791640 1 --2- 172.21.15.121:0/3498780759 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff18809ca50 0x7ff188122dc0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:44.920 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:44.920+0000 7ff18e791640 1 -- 172.21.15.121:0/3498780759 >> 172.21.15.121:0/3498780759 conn(0x7ff1880a5230 msgr2=0x7ff1880a74c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:44.921 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:44.920+0000 7ff18e791640 1 -- 172.21.15.121:0/3498780759 shutdown_connections 2024-09-16T07:33:44.921 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:44.920+0000 7ff18e791640 1 -- 172.21.15.121:0/3498780759 wait complete. 2024-09-16T07:33:44.930 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-16T07:33:44.930 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-16T07:33:45.334 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-16T07:33:45.438 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:45.434+0000 7f45d069c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:45.438 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:45.439+0000 7f45d069c640 1 Processor -- start 2024-09-16T07:33:45.439 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:45.440+0000 7f45d069c640 1 -- start start 2024-09-16T07:33:45.441 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:45.441+0000 7f45d069c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f45c80a04b0 0x7f45c813b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:45.441 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:45.441+0000 7f45d069c640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45c80a8300 con 0x7f45c809f990 2024-09-16T07:33:45.441 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:45.441+0000 7f45d069c640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f45c80a08c0 con 0x7f45c80a04b0 2024-09-16T07:33:45.441 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:45.441+0000 7f45cdc37640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f45c80a04b0 0x7f45c813b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:45.441 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:45.441+0000 7f45ce438640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f45c809f990 0x7f45c809fda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:44724/0 (socket says 172.21.15.121:44724) 2024-09-16T07:33:45.441 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:45.441+0000 7f45ce438640 1 -- 172.21.15.121:0/2113110432 learned_addr learned my addr 172.21.15.121:0/2113110432 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-16T07:33:45.441 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:45.441+0000 7f45cd436640 1 -- 172.21.15.121:0/2113110432 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1709223024 0 0) 0x7f45c80a8300 con 0x7f45c809f990 2024-09-16T07:33:45.441 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:45.441+0000 7f45cd436640 1 -- 172.21.15.121:0/2113110432 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f45b4003580 con 0x7f45c809f990 2024-09-16T07:33:45.442 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:45.441+0000 7f45cdc37640 1 -- 172.21.15.121:0/2113110432 >> v1:172.21.15.121:6789/0 conn(0x7f45c809f990 legacy=0x7f45c809fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:45.442 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:45.441+0000 7f45cdc37640 1 -- 172.21.15.121:0/2113110432 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45c80a14b0 con 0x7f45c80a04b0 2024-09-16T07:33:45.442 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:45.442+0000 7f45cdc37640 1 --2- 172.21.15.121:0/2113110432 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f45c80a04b0 0x7f45c813b610 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a218a2677656826 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:45.442 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:45.442+0000 7f45cd436640 1 -- 172.21.15.121:0/2113110432 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f45c4009d90 con 0x7f45c80a04b0 2024-09-16T07:33:45.442 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:45.442+0000 7f45cd436640 1 -- 172.21.15.121:0/2113110432 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f45c400e230 con 0x7f45c80a04b0 2024-09-16T07:33:45.442 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:45.442+0000 7f45cd436640 1 -- 172.21.15.121:0/2113110432 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f45c400e4d0 con 0x7f45c80a04b0 2024-09-16T07:33:45.443 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:45.443+0000 7f45d069c640 1 -- 172.21.15.121:0/2113110432 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f45c80a04b0 msgr2=0x7f45c813b610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:45.443 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:45.443+0000 7f45d069c640 1 --2- 172.21.15.121:0/2113110432 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f45c80a04b0 0x7f45c813b610 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:45.443 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:45.443+0000 7f45d069c640 1 -- 172.21.15.121:0/2113110432 shutdown_connections 2024-09-16T07:33:45.443 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:45.443+0000 7f45d069c640 1 --2- 172.21.15.121:0/2113110432 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f45c80a04b0 0x7f45c813b610 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:45.443 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:45.443+0000 7f45d069c640 1 -- 172.21.15.121:0/2113110432 >> 172.21.15.121:0/2113110432 conn(0x7f45c80a6390 msgr2=0x7f45c80a67a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:45.443 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:45.443+0000 7f45d069c640 1 -- 172.21.15.121:0/2113110432 shutdown_connections 2024-09-16T07:33:45.443 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:45.443+0000 7f45d069c640 1 -- 172.21.15.121:0/2113110432 wait complete. 2024-09-16T07:33:45.443 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:45.443+0000 7f45d069c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:45.444 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:45.444+0000 7f45d069c640 1 Processor -- start 2024-09-16T07:33:45.444 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:45.444+0000 7f45d069c640 1 -- start start 2024-09-16T07:33:45.445 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:45.445+0000 7f45d069c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f45c809f990 0x7f45c81cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:45.446 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:45.445+0000 7f45d069c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f45c81bad80 con 0x7f45c809f990 2024-09-16T07:33:45.446 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:45.446+0000 7f45ce438640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f45c809f990 0x7f45c81cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:45.446 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:45.446+0000 7f45ce438640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f45c809f990 0x7f45c81cb0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60370/0 (socket says 172.21.15.121:60370) 2024-09-16T07:33:45.446 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:45.446+0000 7f45ce438640 1 -- 172.21.15.121:0/1107690539 learned_addr learned my addr 172.21.15.121:0/1107690539 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:33:45.446 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:45.446+0000 7f45ce438640 1 -- 172.21.15.121:0/1107690539 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45c81b84b0 con 0x7f45c809f990 2024-09-16T07:33:45.446 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:45.446+0000 7f45ce438640 1 --2- 172.21.15.121:0/1107690539 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f45c809f990 0x7f45c81cb0b0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:45.446 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:45.446+0000 7f45beffd640 1 -- 172.21.15.121:0/1107690539 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f45b8005a60 con 0x7f45c809f990 2024-09-16T07:33:45.446 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:45.446+0000 7f45beffd640 1 -- 172.21.15.121:0/1107690539 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f45b8005bc0 con 0x7f45c809f990 2024-09-16T07:33:45.446 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:45.446+0000 7f45d069c640 1 -- 172.21.15.121:0/1107690539 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45c81b9c90 con 0x7f45c809f990 2024-09-16T07:33:45.446 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:45.446+0000 7f45beffd640 1 -- 172.21.15.121:0/1107690539 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f45b8005e60 con 0x7f45c809f990 2024-09-16T07:33:45.446 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:45.446+0000 7f45d069c640 1 -- 172.21.15.121:0/1107690539 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45c81ba540 con 0x7f45c809f990 2024-09-16T07:33:45.446 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:45.446+0000 7f45beffd640 1 -- 172.21.15.121:0/1107690539 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7f45b8007440 con 0x7f45c809f990 2024-09-16T07:33:45.446 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:45.447+0000 7f45beffd640 1 -- 172.21.15.121:0/1107690539 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1207+0+0 (crc 0 0 0) 0x7f45b80076f0 con 0x7f45c809f990 2024-09-16T07:33:45.447 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:45.447+0000 7f45d069c640 1 -- 172.21.15.121:0/1107690539 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45c806d590 con 0x7f45c809f990 2024-09-16T07:33:45.450 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:45.452+0000 7f45beffd640 1 -- 172.21.15.121:0/1107690539 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (crc 0 0 0) 0x7f45b800c750 con 0x7f45c809f990 2024-09-16T07:33:45.512 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:45.512+0000 7f45d069c640 1 -- 172.21.15.121:0/1107690539 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f45c80752b0 con 0x7f45c809f990 2024-09-16T07:33:45.512 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:45.513+0000 7f45beffd640 1 -- 172.21.15.121:0/1107690539 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v7) ==== 74+0+4152 (crc 0 0 0) 0x7f45b800c8f0 con 0x7f45c809f990 2024-09-16T07:33:45.512 INFO:teuthology.misc.health.smithi121.stdout: 2024-09-16T07:33:45.512 INFO:teuthology.misc.health.smithi121.stdout:{"epoch":7,"fsid":"5b0c4070-0374-47d9-9f2a-f525ac27c89c","created":"2024-09-16T07:33:42.277188+0000","modified":"2024-09-16T07:33:44.410434+0000","last_up_change":"0.000000","last_in_change":"2024-09-16T07:33:44.410434+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"ff74ae4d-122c-4c59-9a69-b559f9f27a32","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"0d1cdc37-865f-43c6-af56-0ca5fb928e02","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"429c0781-5021-41da-8e0e-985110dcea52","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"0ea1bce1-3795-403b-af2f-e62972443062","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:33:45.513 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:45.514+0000 7f45d069c640 1 -- 172.21.15.121:0/1107690539 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f45c809f990 msgr2=0x7f45c81cb0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:45.514 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:45.514+0000 7f45d069c640 1 --2- 172.21.15.121:0/1107690539 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f45c809f990 0x7f45c81cb0b0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:45.514 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:45.514+0000 7f45d069c640 1 -- 172.21.15.121:0/1107690539 shutdown_connections 2024-09-16T07:33:45.514 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:45.514+0000 7f45d069c640 1 --2- 172.21.15.121:0/1107690539 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f45c809f990 0x7f45c81cb0b0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:45.514 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:45.514+0000 7f45d069c640 1 -- 172.21.15.121:0/1107690539 >> 172.21.15.121:0/1107690539 conn(0x7f45c80a6390 msgr2=0x7f45c80a3750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:45.514 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:45.514+0000 7f45d069c640 1 -- 172.21.15.121:0/1107690539 shutdown_connections 2024-09-16T07:33:45.514 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:45.514+0000 7f45d069c640 1 -- 172.21.15.121:0/1107690539 wait complete. 2024-09-16T07:33:45.523 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-09-16T07:33:47.858 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-09-16T07:33:47.859+0000 7fb18ae6d640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-09-16T07:33:51.927 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-16T07:33:52.035 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:52.031+0000 7f87cf85c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:52.035 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:52.036+0000 7f87cf85c640 1 Processor -- start 2024-09-16T07:33:52.036 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:52.037+0000 7f87cf85c640 1 -- start start 2024-09-16T07:33:52.038 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:52.038+0000 7f87cf85c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f87c80a04b0 0x7f87c813b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:52.038 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:52.038+0000 7f87cf85c640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87c80a8300 con 0x7f87c809f990 2024-09-16T07:33:52.038 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:52.038+0000 7f87cf85c640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f87c80a08c0 con 0x7f87c80a04b0 2024-09-16T07:33:52.038 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:52.038+0000 7f87ccdf7640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f87c80a04b0 0x7f87c813b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:52.038 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:52.038+0000 7f87cd5f8640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f87c809f990 0x7f87c809fda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:44740/0 (socket says 172.21.15.121:44740) 2024-09-16T07:33:52.038 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:52.038+0000 7f87cd5f8640 1 -- 172.21.15.121:0/3041362945 learned_addr learned my addr 172.21.15.121:0/3041362945 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-16T07:33:52.038 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:52.038+0000 7f87ccdf7640 1 -- 172.21.15.121:0/3041362945 >> v1:172.21.15.121:6789/0 conn(0x7f87c809f990 legacy=0x7f87c809fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:52.038 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:52.038+0000 7f87ccdf7640 1 -- 172.21.15.121:0/3041362945 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87c80a14b0 con 0x7f87c80a04b0 2024-09-16T07:33:52.038 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:52.038+0000 7f87ccdf7640 1 --2- 172.21.15.121:0/3041362945 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87c80a04b0 0x7f87c813b610 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=646f582a024ea968 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:52.038 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:52.038+0000 7f87c7fff640 1 -- 172.21.15.121:0/3041362945 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f87bc00e040 con 0x7f87c80a04b0 2024-09-16T07:33:52.038 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:52.038+0000 7f87c7fff640 1 -- 172.21.15.121:0/3041362945 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f87bc007670 con 0x7f87c80a04b0 2024-09-16T07:33:52.038 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:52.038+0000 7f87c7fff640 1 -- 172.21.15.121:0/3041362945 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f87bc007910 con 0x7f87c80a04b0 2024-09-16T07:33:52.039 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:52.039+0000 7f87cf85c640 1 -- 172.21.15.121:0/3041362945 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87c80a04b0 msgr2=0x7f87c813b610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:52.039 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:52.039+0000 7f87cf85c640 1 --2- 172.21.15.121:0/3041362945 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87c80a04b0 0x7f87c813b610 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:52.040 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:52.039+0000 7f87cf85c640 1 -- 172.21.15.121:0/3041362945 shutdown_connections 2024-09-16T07:33:52.040 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:52.039+0000 7f87cf85c640 1 --2- 172.21.15.121:0/3041362945 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87c80a04b0 0x7f87c813b610 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:52.040 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:52.039+0000 7f87cf85c640 1 -- 172.21.15.121:0/3041362945 >> 172.21.15.121:0/3041362945 conn(0x7f87c80a6390 msgr2=0x7f87c80a67a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:52.040 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:52.039+0000 7f87cf85c640 1 -- 172.21.15.121:0/3041362945 shutdown_connections 2024-09-16T07:33:52.040 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:52.040+0000 7f87cf85c640 1 -- 172.21.15.121:0/3041362945 wait complete. 2024-09-16T07:33:52.040 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:52.040+0000 7f87cf85c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:52.040 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:52.041+0000 7f87cf85c640 1 Processor -- start 2024-09-16T07:33:52.040 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:52.041+0000 7f87cf85c640 1 -- start start 2024-09-16T07:33:52.042 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:52.042+0000 7f87cf85c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87c809f990 0x7f87c81bb910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:52.042 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:52.042+0000 7f87cf85c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f87c81b9bd0 con 0x7f87c809f990 2024-09-16T07:33:52.042 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:52.042+0000 7f87cd5f8640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87c809f990 0x7f87c81bb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:52.043 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:52.042+0000 7f87cd5f8640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87c809f990 0x7f87c81bb910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60386/0 (socket says 172.21.15.121:60386) 2024-09-16T07:33:52.043 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:52.042+0000 7f87cd5f8640 1 -- 172.21.15.121:0/934430667 learned_addr learned my addr 172.21.15.121:0/934430667 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:33:52.043 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:52.042+0000 7f87cd5f8640 1 -- 172.21.15.121:0/934430667 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87c81bb470 con 0x7f87c809f990 2024-09-16T07:33:52.043 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:52.043+0000 7f87cd5f8640 1 --2- 172.21.15.121:0/934430667 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87c809f990 0x7f87c81bb910 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:52.043 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:52.043+0000 7f87c5ffb640 1 -- 172.21.15.121:0/934430667 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f87c0005a60 con 0x7f87c809f990 2024-09-16T07:33:52.043 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:52.043+0000 7f87c5ffb640 1 -- 172.21.15.121:0/934430667 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f87c0005bc0 con 0x7f87c809f990 2024-09-16T07:33:52.043 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:52.043+0000 7f87c5ffb640 1 -- 172.21.15.121:0/934430667 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f87c0005e60 con 0x7f87c809f990 2024-09-16T07:33:52.043 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:52.043+0000 7f87cf85c640 1 -- 172.21.15.121:0/934430667 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87c8073640 con 0x7f87c809f990 2024-09-16T07:33:52.043 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:52.043+0000 7f87cf85c640 1 -- 172.21.15.121:0/934430667 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87c81ba8f0 con 0x7f87c809f990 2024-09-16T07:33:52.044 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:52.044+0000 7f87cf85c640 1 -- 172.21.15.121:0/934430667 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87c81ba370 con 0x7f87c809f990 2024-09-16T07:33:52.044 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:52.044+0000 7f87c5ffb640 1 -- 172.21.15.121:0/934430667 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 4) ==== 50898+0+0 (crc 0 0 0) 0x7f87c000c7f0 con 0x7f87c809f990 2024-09-16T07:33:52.044 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:52.044+0000 7f87c5ffb640 1 --2- 172.21.15.121:0/934430667 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f87b403e8a0 0x7f87b4040db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:52.044 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:52.044+0000 7f87c5ffb640 1 -- 172.21.15.121:0/934430667 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 2319+0+0 (crc 0 0 0) 0x7f87c004f400 con 0x7f87c809f990 2024-09-16T07:33:52.044 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:52.044+0000 7f87ccdf7640 1 --2- 172.21.15.121:0/934430667 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f87b403e8a0 0x7f87b4040db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:52.044 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:52.045+0000 7f87ccdf7640 1 --2- 172.21.15.121:0/934430667 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f87b403e8a0 0x7f87b4040db0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:52.049 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:52.050+0000 7f87c5ffb640 1 -- 172.21.15.121:0/934430667 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f87c000dc10 con 0x7f87c809f990 2024-09-16T07:33:52.235 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:52.235+0000 7f87cf85c640 1 -- 172.21.15.121:0/934430667 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f87c809fda0 con 0x7f87c809f990 2024-09-16T07:33:52.235 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:52.236+0000 7f87c5ffb640 1 -- 172.21.15.121:0/934430667 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) ==== 74+0+6987 (crc 0 0 0) 0x7f87c000d610 con 0x7f87c809f990 2024-09-16T07:33:52.235 INFO:teuthology.misc.health.smithi121.stdout: 2024-09-16T07:33:52.235 INFO:teuthology.misc.health.smithi121.stdout:{"epoch":11,"fsid":"5b0c4070-0374-47d9-9f2a-f525ac27c89c","created":"2024-09-16T07:33:42.277188+0000","modified":"2024-09-16T07:33:51.924610+0000","last_up_change":"2024-09-16T07:33:49.860289+0000","last_in_change":"2024-09-16T07:33:44.410434+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:33:50.873314+0000","flags":294945,"flags_names":"hashpspool,nopgchange,creating,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ff74ae4d-122c-4c59-9a69-b559f9f27a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3193900849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6807","nonce":3193900849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":3193900849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6803","nonce":3193900849}]},"public_addr":"172.21.15.121:6808/3193900849","cluster_addr":"172.21.15.121:6807/3193900849","heartbeat_back_addr":"172.21.15.121:6804/3193900849","heartbeat_front_addr":"172.21.15.121:6803/3193900849","state":["exists","up"]},{"osd":1,"uuid":"0d1cdc37-865f-43c6-af56-0ca5fb928e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6801","nonce":4208564222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":4208564222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":4208564222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6805","nonce":4208564222}]},"public_addr":"172.21.15.121:6801/4208564222","cluster_addr":"172.21.15.121:6800/4208564222","heartbeat_back_addr":"172.21.15.121:6802/4208564222","heartbeat_front_addr":"172.21.15.121:6805/4208564222","state":["exists","up"]},{"osd":2,"uuid":"429c0781-5021-41da-8e0e-985110dcea52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2274906412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6803","nonce":2274906412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2274906412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2274906412}]},"public_addr":"172.21.15.172:6804/2274906412","cluster_addr":"172.21.15.172:6803/2274906412","heartbeat_back_addr":"172.21.15.172:6813/2274906412","heartbeat_front_addr":"172.21.15.172:6814/2274906412","state":["exists","up"]},{"osd":3,"uuid":"0ea1bce1-3795-403b-af2f-e62972443062","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3418488586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6807","nonce":3418488586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3418488586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3418488586}]},"public_addr":"172.21.15.172:6808/3418488586","cluster_addr":"172.21.15.172:6807/3418488586","heartbeat_back_addr":"172.21.15.172:6805/3418488586","heartbeat_front_addr":"172.21.15.172:6806/3418488586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:33:52.238 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:52.238+0000 7f87cf85c640 1 -- 172.21.15.121:0/934430667 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f87b403e8a0 msgr2=0x7f87b4040db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:52.238 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:52.238+0000 7f87cf85c640 1 --2- 172.21.15.121:0/934430667 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f87b403e8a0 0x7f87b4040db0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:52.238 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:52.238+0000 7f87cf85c640 1 -- 172.21.15.121:0/934430667 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87c809f990 msgr2=0x7f87c81bb910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:52.238 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:52.238+0000 7f87cf85c640 1 --2- 172.21.15.121:0/934430667 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87c809f990 0x7f87c81bb910 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:52.238 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:52.238+0000 7f87cf85c640 1 -- 172.21.15.121:0/934430667 shutdown_connections 2024-09-16T07:33:52.238 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:52.238+0000 7f87cf85c640 1 --2- 172.21.15.121:0/934430667 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f87b403e8a0 0x7f87b4040db0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:52.238 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:52.238+0000 7f87cf85c640 1 --2- 172.21.15.121:0/934430667 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87c809f990 0x7f87c81bb910 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:52.238 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:52.238+0000 7f87cf85c640 1 -- 172.21.15.121:0/934430667 >> 172.21.15.121:0/934430667 conn(0x7f87c80a6390 msgr2=0x7f87c80a2d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:52.238 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:52.238+0000 7f87cf85c640 1 -- 172.21.15.121:0/934430667 shutdown_connections 2024-09-16T07:33:52.238 INFO:teuthology.misc.health.smithi121.stderr:2024-09-16T07:33:52.238+0000 7f87cf85c640 1 -- 172.21.15.121:0/934430667 wait complete. 2024-09-16T07:33:52.247 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-09-16T07:33:52.248 INFO:tasks.ceph:Creating RBD pool 2024-09-16T07:33:52.248 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-16T07:33:52.357 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:52.351+0000 7fa576b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:52.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:52.359+0000 7fa576b91640 1 Processor -- start 2024-09-16T07:33:52.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:52.359+0000 7fa576b91640 1 -- start start 2024-09-16T07:33:52.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:52.360+0000 7fa576b91640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa570068d40 0x7fa570069150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:52.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:52.360+0000 7fa576b91640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa57009f0d0 con 0x7fa570069690 2024-09-16T07:33:52.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:52.360+0000 7fa576b91640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fa57006c880 con 0x7fa570068d40 2024-09-16T07:33:52.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:52.361+0000 7fa57492d640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa570068d40 0x7fa570069150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:52.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:52.361+0000 7fa57492d640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa570068d40 0x7fa570069150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60394/0 (socket says 172.21.15.121:60394) 2024-09-16T07:33:52.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:52.361+0000 7fa57492d640 1 -- 172.21.15.121:0/3294066981 learned_addr learned my addr 172.21.15.121:0/3294066981 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:33:52.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:52.361+0000 7fa57492d640 1 -- 172.21.15.121:0/3294066981 >> v1:172.21.15.121:6789/0 conn(0x7fa570069690 legacy=0x7fa570138410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:52.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:52.361+0000 7fa57492d640 1 -- 172.21.15.121:0/3294066981 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa57009f300 con 0x7fa570068d40 2024-09-16T07:33:52.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:52.361+0000 7fa57492d640 1 --2- 172.21.15.121:0/3294066981 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa570068d40 0x7fa570069150 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41acc16662e86372 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:52.414 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:52.415+0000 7fa56f7fe640 1 -- 172.21.15.121:0/3294066981 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa560009e50 con 0x7fa570068d40 2024-09-16T07:33:52.414 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:52.415+0000 7fa56f7fe640 1 -- 172.21.15.121:0/3294066981 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa56000e230 con 0x7fa570068d40 2024-09-16T07:33:52.415 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:52.415+0000 7fa56f7fe640 1 -- 172.21.15.121:0/3294066981 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa56000e4d0 con 0x7fa570068d40 2024-09-16T07:33:52.415 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:52.416+0000 7fa576b91640 1 -- 172.21.15.121:0/3294066981 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa570068d40 msgr2=0x7fa570069150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:52.415 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:52.416+0000 7fa576b91640 1 --2- 172.21.15.121:0/3294066981 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa570068d40 0x7fa570069150 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:52.416 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:52.416+0000 7fa576b91640 1 -- 172.21.15.121:0/3294066981 shutdown_connections 2024-09-16T07:33:52.416 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:52.416+0000 7fa576b91640 1 --2- 172.21.15.121:0/3294066981 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa570068d40 0x7fa570069150 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:52.416 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:52.416+0000 7fa576b91640 1 -- 172.21.15.121:0/3294066981 >> 172.21.15.121:0/3294066981 conn(0x7fa5700a3330 msgr2=0x7fa5700a3740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:52.416 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:52.416+0000 7fa576b91640 1 -- 172.21.15.121:0/3294066981 shutdown_connections 2024-09-16T07:33:52.416 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:52.416+0000 7fa576b91640 1 -- 172.21.15.121:0/3294066981 wait complete. 2024-09-16T07:33:52.416 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:52.416+0000 7fa576b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:52.417 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:52.418+0000 7fa576b91640 1 Processor -- start 2024-09-16T07:33:52.417 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:52.418+0000 7fa576b91640 1 -- start start 2024-09-16T07:33:52.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:52.419+0000 7fa576b91640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa570068d40 0x7fa5701b7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:52.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:52.419+0000 7fa576b91640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa5701b6d30 con 0x7fa570068d40 2024-09-16T07:33:52.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:52.419+0000 7fa57492d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa570068d40 0x7fa5701b7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:52.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:52.419+0000 7fa57492d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa570068d40 0x7fa5701b7370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60396/0 (socket says 172.21.15.121:60396) 2024-09-16T07:33:52.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:52.419+0000 7fa57492d640 1 -- 172.21.15.121:0/2001564040 learned_addr learned my addr 172.21.15.121:0/2001564040 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:33:52.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:52.419+0000 7fa57492d640 1 -- 172.21.15.121:0/2001564040 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5701b9490 con 0x7fa570068d40 2024-09-16T07:33:52.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:52.420+0000 7fa57492d640 1 --2- 172.21.15.121:0/2001564040 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa570068d40 0x7fa5701b7370 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:52.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:52.420+0000 7fa56d7fa640 1 -- 172.21.15.121:0/2001564040 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa56000edb0 con 0x7fa570068d40 2024-09-16T07:33:52.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:52.420+0000 7fa56d7fa640 1 -- 172.21.15.121:0/2001564040 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa560015420 con 0x7fa570068d40 2024-09-16T07:33:52.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:52.420+0000 7fa576b91640 1 -- 172.21.15.121:0/2001564040 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5701b8630 con 0x7fa570068d40 2024-09-16T07:33:52.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:52.420+0000 7fa56d7fa640 1 -- 172.21.15.121:0/2001564040 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa560015590 con 0x7fa570068d40 2024-09-16T07:33:52.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:52.420+0000 7fa576b91640 1 -- 172.21.15.121:0/2001564040 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5701b8f10 con 0x7fa570068d40 2024-09-16T07:33:52.421 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:52.421+0000 7fa576b91640 1 -- 172.21.15.121:0/2001564040 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5700702e0 con 0x7fa570068d40 2024-09-16T07:33:52.421 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:52.421+0000 7fa56d7fa640 1 -- 172.21.15.121:0/2001564040 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 4) ==== 50898+0+0 (crc 0 0 0) 0x7fa560015740 con 0x7fa570068d40 2024-09-16T07:33:52.421 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:52.421+0000 7fa56d7fa640 1 --2- 172.21.15.121:0/2001564040 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fa55c03e8a0 0x7fa55c040db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:52.421 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:52.421+0000 7fa56d7fa640 1 -- 172.21.15.121:0/2001564040 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 2319+0+0 (crc 0 0 0) 0x7fa5600509c0 con 0x7fa570068d40 2024-09-16T07:33:52.421 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:52.421+0000 7fa56ffff640 1 --2- 172.21.15.121:0/2001564040 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fa55c03e8a0 0x7fa55c040db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:52.421 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:52.422+0000 7fa56ffff640 1 --2- 172.21.15.121:0/2001564040 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fa55c03e8a0 0x7fa55c040db0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:52.428 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:52.427+0000 7fa56d7fa640 1 -- 172.21.15.121:0/2001564040 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fa560010a00 con 0x7fa570068d40 2024-09-16T07:33:52.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:52.612+0000 7fa576b91640 1 -- 172.21.15.121:0/2001564040 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7fa5701baa80 con 0x7fa570068d40 2024-09-16T07:33:52.927 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:52.928+0000 7fa56d7fa640 1 -- 172.21.15.121:0/2001564040 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v12) ==== 109+0+0 (crc 0 0 0) 0x7fa5600059f0 con 0x7fa570068d40 2024-09-16T07:33:52.927 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'rbd' created 2024-09-16T07:33:52.929 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:52.930+0000 7fa576b91640 1 -- 172.21.15.121:0/2001564040 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fa55c03e8a0 msgr2=0x7fa55c040db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:52.930 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:52.930+0000 7fa576b91640 1 --2- 172.21.15.121:0/2001564040 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fa55c03e8a0 0x7fa55c040db0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:52.930 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:52.930+0000 7fa576b91640 1 -- 172.21.15.121:0/2001564040 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa570068d40 msgr2=0x7fa5701b7370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:52.930 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:52.930+0000 7fa576b91640 1 --2- 172.21.15.121:0/2001564040 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa570068d40 0x7fa5701b7370 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:52.930 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:52.930+0000 7fa576b91640 1 -- 172.21.15.121:0/2001564040 shutdown_connections 2024-09-16T07:33:52.930 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:52.930+0000 7fa576b91640 1 --2- 172.21.15.121:0/2001564040 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fa55c03e8a0 0x7fa55c040db0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:52.930 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:52.930+0000 7fa576b91640 1 --2- 172.21.15.121:0/2001564040 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa570068d40 0x7fa5701b7370 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:52.930 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:52.930+0000 7fa576b91640 1 -- 172.21.15.121:0/2001564040 >> 172.21.15.121:0/2001564040 conn(0x7fa5700a3330 msgr2=0x7fa570072c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:52.930 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:52.930+0000 7fa576b91640 1 -- 172.21.15.121:0/2001564040 shutdown_connections 2024-09-16T07:33:52.930 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:52.930+0000 7fa576b91640 1 -- 172.21.15.121:0/2001564040 wait complete. 2024-09-16T07:33:52.944 DEBUG:teuthology.orchestra.run.smithi121:> rbd --cluster ceph pool init rbd 2024-09-16T07:33:53.066 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:53.067+0000 7f0f64fd7ac0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:53.066 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:53.067+0000 7f0f64fd7ac0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:53.067 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:53.068+0000 7f0f64fd7ac0 1 Processor -- start 2024-09-16T07:33:53.067 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:53.068+0000 7f0f64fd7ac0 1 -- start start 2024-09-16T07:33:53.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:53.069+0000 7f0f64fd7ac0 1 --2- >> v2:172.21.15.121:3300/0 conn(0x16fd1d0 0x16fd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:53.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:53.069+0000 7f0f64fd7ac0 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x1562180 con 0x16fdb20 2024-09-16T07:33:53.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:53.069+0000 7f0f64fd7ac0 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x15a1b90 con 0x16fd1d0 2024-09-16T07:33:53.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:53.069+0000 7f0f5fae9640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x16fd1d0 0x16fd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:53.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:53.069+0000 7f0f5f2e8640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x16fdb20 0x1799cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:44754/0 (socket says 172.21.15.121:44754) 2024-09-16T07:33:53.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:53.069+0000 7f0f5f2e8640 1 -- 172.21.15.121:0/2061322956 learned_addr learned my addr 172.21.15.121:0/2061322956 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-16T07:33:53.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:53.069+0000 7f0f5fae9640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x16fd1d0 0x16fd5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60406/0 (socket says 172.21.15.121:60406) 2024-09-16T07:33:53.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:53.070+0000 7f0f5fae9640 1 -- 172.21.15.121:0/2061322956 >> v1:172.21.15.121:6789/0 conn(0x16fdb20 legacy=0x1799cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:53.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:53.070+0000 7f0f5fae9640 1 -- 172.21.15.121:0/2061322956 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x1537f80 con 0x16fd1d0 2024-09-16T07:33:53.070 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:53.071+0000 7f0f5fae9640 1 --2- 172.21.15.121:0/2061322956 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x16fd1d0 0x16fd5e0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2543c731f486d3fa server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:53.070 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:53.071+0000 7f0f5eae7640 1 -- 172.21.15.121:0/2061322956 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0f4802d500 con 0x16fd1d0 2024-09-16T07:33:53.070 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:53.071+0000 7f0f5eae7640 1 -- 172.21.15.121:0/2061322956 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0f4802d660 con 0x16fd1d0 2024-09-16T07:33:53.070 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:53.071+0000 7f0f5eae7640 1 -- 172.21.15.121:0/2061322956 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0f4802d900 con 0x16fd1d0 2024-09-16T07:33:53.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:53.072+0000 7f0f64fd7ac0 1 -- 172.21.15.121:0/2061322956 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x16fd1d0 msgr2=0x16fd5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:53.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:53.072+0000 7f0f64fd7ac0 1 --2- 172.21.15.121:0/2061322956 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x16fd1d0 0x16fd5e0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:53.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:53.072+0000 7f0f64fd7ac0 1 -- 172.21.15.121:0/2061322956 shutdown_connections 2024-09-16T07:33:53.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:53.072+0000 7f0f64fd7ac0 1 --2- 172.21.15.121:0/2061322956 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x16fd1d0 0x16fd5e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:53.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:53.072+0000 7f0f64fd7ac0 1 -- 172.21.15.121:0/2061322956 >> 172.21.15.121:0/2061322956 conn(0x150af70 msgr2=0x16fb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:53.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:53.072+0000 7f0f64fd7ac0 1 -- 172.21.15.121:0/2061322956 shutdown_connections 2024-09-16T07:33:53.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:53.072+0000 7f0f64fd7ac0 1 -- 172.21.15.121:0/2061322956 wait complete. 2024-09-16T07:33:53.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:53.072+0000 7f0f64fd7ac0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:53.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:53.073+0000 7f0f64fd7ac0 1 Processor -- start 2024-09-16T07:33:53.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:53.073+0000 7f0f64fd7ac0 1 -- start start 2024-09-16T07:33:53.074 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:53.074+0000 7f0f64fd7ac0 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x16fd1d0 0x1780b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:53.074 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:53.074+0000 7f0f64fd7ac0 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x15ac8f0 con 0x16fd1d0 2024-09-16T07:33:53.074 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:53.074+0000 7f0f5fae9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x16fd1d0 0x1780b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:53.075 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:53.074+0000 7f0f5fae9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x16fd1d0 0x1780b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60408/0 (socket says 172.21.15.121:60408) 2024-09-16T07:33:53.075 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:53.074+0000 7f0f5fae9640 1 -- 172.21.15.121:0/1483691915 learned_addr learned my addr 172.21.15.121:0/1483691915 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:33:53.075 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:53.075+0000 7f0f5fae9640 1 -- 172.21.15.121:0/1483691915 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1546800 con 0x16fd1d0 2024-09-16T07:33:53.075 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:53.075+0000 7f0f5fae9640 1 --2- 172.21.15.121:0/1483691915 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x16fd1d0 0x1780b90 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:53.075 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:53.075+0000 7f0f57fff640 1 -- 172.21.15.121:0/1483691915 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0f48034410 con 0x16fd1d0 2024-09-16T07:33:53.075 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:53.075+0000 7f0f57fff640 1 -- 172.21.15.121:0/1483691915 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0f48034570 con 0x16fd1d0 2024-09-16T07:33:53.075 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:53.075+0000 7f0f64fd7ac0 1 -- 172.21.15.121:0/1483691915 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1538310 con 0x16fd1d0 2024-09-16T07:33:53.075 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:53.075+0000 7f0f57fff640 1 -- 172.21.15.121:0/1483691915 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0f48034810 con 0x16fd1d0 2024-09-16T07:33:53.075 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:53.075+0000 7f0f64fd7ac0 1 -- 172.21.15.121:0/1483691915 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1537d70 con 0x16fd1d0 2024-09-16T07:33:53.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:53.076+0000 7f0f57fff640 1 -- 172.21.15.121:0/1483691915 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 4) ==== 50898+0+0 (crc 0 0 0) 0x7f0f48036040 con 0x16fd1d0 2024-09-16T07:33:53.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:53.076+0000 7f0f57fff640 1 --2- 172.21.15.121:0/1483691915 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f0f4403d130 0x7f0f4403f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:53.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:53.076+0000 7f0f57fff640 1 -- 172.21.15.121:0/1483691915 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2661+0+0 (crc 0 0 0) 0x7f0f48032040 con 0x16fd1d0 2024-09-16T07:33:53.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:53.076+0000 7f0f64fd7ac0 1 -- 172.21.15.121:0/1483691915 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool application enable","pool": "rbd","app": "rbd"} v 0) -- 0x1797a30 con 0x16fd1d0 2024-09-16T07:33:53.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:53.077+0000 7f0f5f2e8640 1 --2- 172.21.15.121:0/1483691915 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f0f4403d130 0x7f0f4403f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:53.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:53.077+0000 7f0f5f2e8640 1 --2- 172.21.15.121:0/1483691915 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f0f4403d130 0x7f0f4403f640 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:53.637 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:53.638+0000 7f0f57fff640 1 -- 172.21.15.121:0/1483691915 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f0f48036d40 con 0x16fd1d0 2024-09-16T07:33:53.938 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:53.938+0000 7f0f57fff640 1 -- 172.21.15.121:0/1483691915 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v13) ==== 141+0+0 (crc 0 0 0) 0x7f0f48032cf0 con 0x16fd1d0 2024-09-16T07:33:53.938 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:53.939+0000 7f0f64fd7ac0 1 -- 172.21.15.121:0/1483691915 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x155f520 con 0x16fd1d0 2024-09-16T07:33:53.941 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:53.941+0000 7f0f57fff640 1 -- 172.21.15.121:0/1483691915 <== mon.0 v2:172.21.15.121:3300/0 8 ==== mon_get_version_reply(handle=1 version=13) ==== 24+0+0 (crc 0 0 0) 0x7f0f480379f0 con 0x16fd1d0 2024-09-16T07:33:53.941 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:53.941+0000 7f0f5e2e6640 1 -- 172.21.15.121:0/1483691915 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=13}) -- 0x7f0f38002ae0 con 0x16fd1d0 2024-09-16T07:33:53.941 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:53.941+0000 7f0f57fff640 1 -- 172.21.15.121:0/1483691915 <== mon.0 v2:172.21.15.121:3300/0 9 ==== osd_map(13..13 src has 1..13) ==== 658+0+0 (crc 0 0 0) 0x7f0f48007740 con 0x16fd1d0 2024-09-16T07:33:53.941 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:53.942+0000 7f0f64fd7ac0 1 --2- 172.21.15.121:0/1483691915 >> v2:172.21.15.121:6801/4208564222 conn(0x16fdb20 0x17815e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:53.941 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:53.942+0000 7f0f64fd7ac0 1 -- 172.21.15.121:0/1483691915 --> v2:172.21.15.121:6801/4208564222 -- osd_op(unknown.0.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13) -- 0x17a95b0 con 0x16fdb20 2024-09-16T07:33:53.943 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:53.944+0000 7f0f60d4b640 1 --2- 172.21.15.121:0/1483691915 >> v2:172.21.15.121:6801/4208564222 conn(0x16fdb20 0x17815e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T07:33:53.980 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:53.981+0000 7f0f60d4b640 1 --2- 172.21.15.121:0/1483691915 >> v2:172.21.15.121:6801/4208564222 conn(0x16fdb20 0x17815e0 crc :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:54.032 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:54.033+0000 7f0f60d4b640 1 -- 172.21.15.121:0/1483691915 <== osd.1 v2:172.21.15.121:6801/4208564222 1 ==== osd_op_reply(1 rbd_trash [create] v13'1 uv1 ondisk = 0) ==== 153+0+0 (crc 0 0 0) 0x7f0f5000c430 con 0x16fdb20 2024-09-16T07:33:54.035 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:54.036+0000 7f0f64fd7ac0 1 --2- 172.21.15.121:0/1483691915 >> v2:172.21.15.121:6808/3193900849 conn(0x17fc240 0x17fe720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:54.035 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:54.036+0000 7f0f64fd7ac0 1 -- 172.21.15.121:0/1483691915 --> v2:172.21.15.121:6808/3193900849 -- osd_op(unknown.0.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e13) -- 0x17fecf0 con 0x17fc240 2024-09-16T07:33:54.036 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:54.037+0000 7f0f5fae9640 1 --2- 172.21.15.121:0/1483691915 >> v2:172.21.15.121:6808/3193900849 conn(0x17fc240 0x17fe720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T07:33:54.039 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:54.040+0000 7f0f5fae9640 1 --2- 172.21.15.121:0/1483691915 >> v2:172.21.15.121:6808/3193900849 conn(0x17fc240 0x17fe720 crc :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:54.044 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:54.045+0000 7f0f5fae9640 1 -- 172.21.15.121:0/1483691915 <== osd.0 v2:172.21.15.121:6808/3193900849 1 ==== osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0f48009da0 con 0x17fc240 2024-09-16T07:33:54.044 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:54.045+0000 7f0f64fd7ac0 1 -- 172.21.15.121:0/1483691915 --> v2:172.21.15.121:6808/3193900849 -- osd_op(unknown.0.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e13) -- 0x17fb700 con 0x17fc240 2024-09-16T07:33:54.047 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:54.048+0000 7f0f5fae9640 1 -- 172.21.15.121:0/1483691915 <== osd.0 v2:172.21.15.121:6808/3193900849 2 ==== osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0f48009da0 con 0x17fc240 2024-09-16T07:33:54.047 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:54.048+0000 7f0f5dae5640 1 -- 172.21.15.121:0/1483691915 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- pool_op(create unmanaged snap pool 2 tid 4 name v0) -- 0x7f0f3c001f60 con 0x16fd1d0 2024-09-16T07:33:54.941 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:54.942+0000 7f0f57fff640 1 -- 172.21.15.121:0/1483691915 <== mon.0 v2:172.21.15.121:3300/0 10 ==== pool_op_reply(tid 4 (0) Success v14) ==== 55+0+0 (crc 0 0 0) 0x7f0f48004600 con 0x16fd1d0 2024-09-16T07:33:54.941 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:54.942+0000 7f0f57fff640 1 -- 172.21.15.121:0/1483691915 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=14}) -- 0x7f0f440423e0 con 0x16fd1d0 2024-09-16T07:33:54.941 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:54.942+0000 7f0f57fff640 1 -- 172.21.15.121:0/1483691915 <== mon.0 v2:172.21.15.121:3300/0 11 ==== osd_map(14..14 src has 1..14) ==== 626+0+0 (crc 0 0 0) 0x7f0f4805d650 con 0x16fd1d0 2024-09-16T07:33:54.942 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:54.942+0000 7f0f5e2e6640 1 -- 172.21.15.121:0/1483691915 --> v2:172.21.15.121:6808/3193900849 -- osd_op(unknown.0.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14) -- 0x7f0f38005640 con 0x17fc240 2024-09-16T07:33:54.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:54.968+0000 7f0f5fae9640 1 -- 172.21.15.121:0/1483691915 <== osd.0 v2:172.21.15.121:6808/3193900849 3 ==== osd_op_reply(5 rbd_info [create,write 0~8] v14'1 uv1 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f0f48009da0 con 0x17fc240 2024-09-16T07:33:54.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:54.968+0000 7f0f5dae5640 1 -- 172.21.15.121:0/1483691915 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- pool_op(delete unmanaged snap pool 2 tid 6 name v14) -- 0x7f0f3c003370 con 0x16fd1d0 2024-09-16T07:33:55.948 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:55.948+0000 7f0f57fff640 1 -- 172.21.15.121:0/1483691915 <== mon.0 v2:172.21.15.121:3300/0 12 ==== pool_op_reply(tid 6 (0) Success v15) ==== 43+0+0 (crc 0 0 0) 0x7f0f480047e0 con 0x16fd1d0 2024-09-16T07:33:55.948 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:55.948+0000 7f0f57fff640 1 -- 172.21.15.121:0/1483691915 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=15}) -- 0x7f0f44042620 con 0x16fd1d0 2024-09-16T07:33:55.948 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:55.949+0000 7f0f57fff640 1 -- 172.21.15.121:0/1483691915 <== mon.0 v2:172.21.15.121:3300/0 13 ==== osd_map(15..15 src has 1..15) ==== 654+0+0 (crc 0 0 0) 0x7f0f4802f0b0 con 0x16fd1d0 2024-09-16T07:33:55.948 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:55.949+0000 7f0f5e2e6640 1 -- 172.21.15.121:0/1483691915 --> v2:172.21.15.121:6808/3193900849 -- osd_op(unknown.0.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19 in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15) -- 0x7f0f380059a0 con 0x17fc240 2024-09-16T07:33:55.974 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:55.974+0000 7f0f5fae9640 1 -- 172.21.15.121:0/1483691915 <== osd.0 v2:172.21.15.121:6808/3193900849 4 ==== osd_op_reply(7 rbd_info [write 0~19] v15'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f48009da0 con 0x17fc240 2024-09-16T07:33:55.974 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:55.974+0000 7f0f64fd7ac0 1 -- 172.21.15.121:0/1483691915 >> v2:172.21.15.121:6808/3193900849 conn(0x17fc240 msgr2=0x17fe720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:55.974 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:55.974+0000 7f0f64fd7ac0 1 --2- 172.21.15.121:0/1483691915 >> v2:172.21.15.121:6808/3193900849 conn(0x17fc240 0x17fe720 crc :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:55.974 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:55.974+0000 7f0f64fd7ac0 1 -- 172.21.15.121:0/1483691915 >> v2:172.21.15.121:6801/4208564222 conn(0x16fdb20 msgr2=0x17815e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:55.974 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:55.974+0000 7f0f64fd7ac0 1 --2- 172.21.15.121:0/1483691915 >> v2:172.21.15.121:6801/4208564222 conn(0x16fdb20 0x17815e0 crc :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:55.974 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:55.974+0000 7f0f64fd7ac0 1 -- 172.21.15.121:0/1483691915 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f0f4403d130 msgr2=0x7f0f4403f640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:55.974 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:55.974+0000 7f0f64fd7ac0 1 --2- 172.21.15.121:0/1483691915 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f0f4403d130 0x7f0f4403f640 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:55.975 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:55.974+0000 7f0f64fd7ac0 1 -- 172.21.15.121:0/1483691915 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x16fd1d0 msgr2=0x1780b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:55.975 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:55.974+0000 7f0f64fd7ac0 1 --2- 172.21.15.121:0/1483691915 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x16fd1d0 0x1780b90 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:55.975 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:55.974+0000 7f0f64fd7ac0 1 -- 172.21.15.121:0/1483691915 shutdown_connections 2024-09-16T07:33:55.975 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:55.974+0000 7f0f64fd7ac0 1 --2- 172.21.15.121:0/1483691915 >> v2:172.21.15.121:6808/3193900849 conn(0x17fc240 0x17fe720 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:55.975 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:55.974+0000 7f0f64fd7ac0 1 --2- 172.21.15.121:0/1483691915 >> v2:172.21.15.121:6801/4208564222 conn(0x16fdb20 0x17815e0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:55.975 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:55.974+0000 7f0f64fd7ac0 1 --2- 172.21.15.121:0/1483691915 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f0f4403d130 0x7f0f4403f640 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:55.975 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:55.974+0000 7f0f64fd7ac0 1 --2- 172.21.15.121:0/1483691915 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x16fd1d0 0x1780b90 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:55.975 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:55.974+0000 7f0f64fd7ac0 1 -- 172.21.15.121:0/1483691915 >> 172.21.15.121:0/1483691915 conn(0x150af70 msgr2=0x1706c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:55.975 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:55.974+0000 7f0f64fd7ac0 1 -- 172.21.15.121:0/1483691915 shutdown_connections 2024-09-16T07:33:55.975 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:55.974+0000 7f0f64fd7ac0 1 -- 172.21.15.121:0/1483691915 wait complete. 2024-09-16T07:33:55.978 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-16T07:33:55.979 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-16T07:33:55.979 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-16T07:33:56.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.084+0000 7fee0a311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:56.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.090+0000 7fee0a311640 1 Processor -- start 2024-09-16T07:33:56.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.090+0000 7fee0a311640 1 -- start start 2024-09-16T07:33:56.091 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.091+0000 7fee0a311640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fee04132790 0x7fee04132ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:56.091 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.092+0000 7fee0a311640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee04098840 con 0x7fee0409b680 2024-09-16T07:33:56.092 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.092+0000 7fee0a311640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fee0409ac90 con 0x7fee04132790 2024-09-16T07:33:56.092 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.092+0000 7fee03fff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fee04132790 0x7fee04132ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:56.092 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.092+0000 7fee03fff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fee04132790 0x7fee04132ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55412/0 (socket says 172.21.15.121:55412) 2024-09-16T07:33:56.092 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.092+0000 7fee037fe640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fee0409b680 0x7fee0409ba90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:57388/0 (socket says 172.21.15.121:57388) 2024-09-16T07:33:56.092 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.092+0000 7fee03fff640 1 -- 172.21.15.121:0/3001752183 learned_addr learned my addr 172.21.15.121:0/3001752183 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:33:56.092 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.092+0000 7fee03fff640 1 -- 172.21.15.121:0/3001752183 >> v1:172.21.15.121:6789/0 conn(0x7fee0409b680 legacy=0x7fee0409ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:56.092 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.092+0000 7fee02ffd640 1 -- 172.21.15.121:0/3001752183 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2445068799 0 0) 0x7fee04098840 con 0x7fee0409b680 2024-09-16T07:33:56.092 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.092+0000 7fee03fff640 1 -- 172.21.15.121:0/3001752183 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee0409cb70 con 0x7fee04132790 2024-09-16T07:33:56.092 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.092+0000 7fee03fff640 1 --2- 172.21.15.121:0/3001752183 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee04132790 0x7fee04132ba0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=424b6597bec92ee4 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:56.092 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.092+0000 7fee02ffd640 1 -- 172.21.15.121:0/3001752183 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fedf400d580 con 0x7fee04132790 2024-09-16T07:33:56.092 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.092+0000 7fee02ffd640 1 -- 172.21.15.121:0/3001752183 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fedf400d6e0 con 0x7fee04132790 2024-09-16T07:33:56.093 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.092+0000 7fee02ffd640 1 -- 172.21.15.121:0/3001752183 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fedf400d980 con 0x7fee04132790 2024-09-16T07:33:56.093 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.093+0000 7fee0a311640 1 -- 172.21.15.121:0/3001752183 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee04132790 msgr2=0x7fee04132ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:56.094 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.093+0000 7fee0a311640 1 --2- 172.21.15.121:0/3001752183 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee04132790 0x7fee04132ba0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:56.094 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.093+0000 7fee0a311640 1 -- 172.21.15.121:0/3001752183 shutdown_connections 2024-09-16T07:33:56.094 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.093+0000 7fee0a311640 1 --2- 172.21.15.121:0/3001752183 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee04132790 0x7fee04132ba0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:56.094 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.093+0000 7fee0a311640 1 -- 172.21.15.121:0/3001752183 >> 172.21.15.121:0/3001752183 conn(0x7fee040a11f0 msgr2=0x7fee040a1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:56.094 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.093+0000 7fee0a311640 1 -- 172.21.15.121:0/3001752183 shutdown_connections 2024-09-16T07:33:56.094 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.093+0000 7fee0a311640 1 -- 172.21.15.121:0/3001752183 wait complete. 2024-09-16T07:33:56.094 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.093+0000 7fee0a311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:56.094 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.095+0000 7fee0a311640 1 Processor -- start 2024-09-16T07:33:56.094 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.095+0000 7fee0a311640 1 -- start start 2024-09-16T07:33:56.096 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.096+0000 7fee0a311640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee0409b680 0x7fee0412fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:56.096 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.096+0000 7fee0a311640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fee0412c830 con 0x7fee0409b680 2024-09-16T07:33:56.096 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.096+0000 7fee03fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee0409b680 0x7fee0412fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:56.096 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.096+0000 7fee03fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee0409b680 0x7fee0412fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55422/0 (socket says 172.21.15.121:55422) 2024-09-16T07:33:56.096 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.096+0000 7fee03fff640 1 -- 172.21.15.121:0/1732771985 learned_addr learned my addr 172.21.15.121:0/1732771985 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:33:56.096 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.096+0000 7fee03fff640 1 -- 172.21.15.121:0/1732771985 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee0412caf0 con 0x7fee0409b680 2024-09-16T07:33:56.096 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.096+0000 7fee03fff640 1 --2- 172.21.15.121:0/1732771985 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee0409b680 0x7fee0412fdc0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:56.096 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.097+0000 7fee00ff9640 1 -- 172.21.15.121:0/1732771985 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fedf400c920 con 0x7fee0409b680 2024-09-16T07:33:56.096 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.097+0000 7fee00ff9640 1 -- 172.21.15.121:0/1732771985 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fedf400ca80 con 0x7fee0409b680 2024-09-16T07:33:56.097 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.097+0000 7fee0a311640 1 -- 172.21.15.121:0/1732771985 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee0412b1b0 con 0x7fee0409b680 2024-09-16T07:33:56.097 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.097+0000 7fee00ff9640 1 -- 172.21.15.121:0/1732771985 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fedf400cd20 con 0x7fee0409b680 2024-09-16T07:33:56.097 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.097+0000 7fee0a311640 1 -- 172.21.15.121:0/1732771985 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee0412b7a0 con 0x7fee0409b680 2024-09-16T07:33:56.097 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.098+0000 7fee0a311640 1 -- 172.21.15.121:0/1732771985 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee0409e480 con 0x7fee0409b680 2024-09-16T07:33:56.098 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.098+0000 7fee00ff9640 1 -- 172.21.15.121:0/1732771985 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fedf4015040 con 0x7fee0409b680 2024-09-16T07:33:56.098 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.098+0000 7fee00ff9640 1 --2- 172.21.15.121:0/1732771985 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fedf003e930 0x7fedf0040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:56.098 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.098+0000 7fee00ff9640 1 -- 172.21.15.121:0/1732771985 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7fedf4012040 con 0x7fee0409b680 2024-09-16T07:33:56.098 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.098+0000 7fee037fe640 1 --2- 172.21.15.121:0/1732771985 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fedf003e930 0x7fedf0040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:56.098 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.099+0000 7fee037fe640 1 --2- 172.21.15.121:0/1732771985 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fedf003e930 0x7fedf0040e40 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:56.102 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.103+0000 7fee00ff9640 1 -- 172.21.15.121:0/1732771985 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fedf4017760 con 0x7fee0409b680 2024-09-16T07:33:56.281 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.282+0000 7fee0a311640 1 -- 172.21.15.121:0/1732771985 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7fee04131980 con 0x7fee0409b680 2024-09-16T07:33:56.282 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.282+0000 7fee00ff9640 1 -- 172.21.15.121:0/1732771985 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v1) ==== 86+0+61 (crc 0 0 0) 0x7fedf4013270 con 0x7fee0409b680 2024-09-16T07:33:56.282 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:33:56.284 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.285+0000 7fee0a311640 1 -- 172.21.15.121:0/1732771985 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fedf003e930 msgr2=0x7fedf0040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:56.284 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.285+0000 7fee0a311640 1 --2- 172.21.15.121:0/1732771985 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fedf003e930 0x7fedf0040e40 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:56.284 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.285+0000 7fee0a311640 1 -- 172.21.15.121:0/1732771985 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee0409b680 msgr2=0x7fee0412fdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:56.284 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.285+0000 7fee0a311640 1 --2- 172.21.15.121:0/1732771985 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee0409b680 0x7fee0412fdc0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:56.284 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.285+0000 7fee0a311640 1 -- 172.21.15.121:0/1732771985 shutdown_connections 2024-09-16T07:33:56.284 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.285+0000 7fee0a311640 1 --2- 172.21.15.121:0/1732771985 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fedf003e930 0x7fedf0040e40 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:56.285 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.285+0000 7fee0a311640 1 --2- 172.21.15.121:0/1732771985 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee0409b680 0x7fee0412fdc0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:56.285 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.285+0000 7fee0a311640 1 -- 172.21.15.121:0/1732771985 >> 172.21.15.121:0/1732771985 conn(0x7fee040a11f0 msgr2=0x7fee040a2ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:56.285 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.285+0000 7fee0a311640 1 -- 172.21.15.121:0/1732771985 shutdown_connections 2024-09-16T07:33:56.285 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.285+0000 7fee0a311640 1 -- 172.21.15.121:0/1732771985 wait complete. 2024-09-16T07:33:56.295 INFO:teuthology.orchestra.run.smithi121.stdout:[{"version":1,"timestamp":"0.000000","name":"","changes":[]}] 2024-09-16T07:33:56.295 INFO:tasks.ceph_manager:config epoch is 1 2024-09-16T07:33:56.295 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-16T07:33:56.295 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-16T07:33:56.295 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-16T07:33:56.401 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.398+0000 7f9bdfcd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:56.402 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.403+0000 7f9bdfcd1640 1 Processor -- start 2024-09-16T07:33:56.402 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.403+0000 7f9bdfcd1640 1 -- start start 2024-09-16T07:33:56.404 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.404+0000 7f9bdfcd1640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f9bd8135c90 0x7f9bd81380b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:56.404 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.404+0000 7f9bdfcd1640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bd809f420 con 0x7f9bd809b470 2024-09-16T07:33:56.404 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.404+0000 7f9bdfcd1640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f9bd8075380 con 0x7f9bd8135c90 2024-09-16T07:33:56.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.405+0000 7f9bdd26c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f9bd8135c90 0x7f9bd81380b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:56.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.405+0000 7f9bdda6d640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f9bd809b470 0x7f9bd809b880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:57394/0 (socket says 172.21.15.121:57394) 2024-09-16T07:33:56.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.405+0000 7f9bdd26c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f9bd8135c90 0x7f9bd81380b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55428/0 (socket says 172.21.15.121:55428) 2024-09-16T07:33:56.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.405+0000 7f9bdda6d640 1 -- 172.21.15.121:0/2786888187 learned_addr learned my addr 172.21.15.121:0/2786888187 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-16T07:33:56.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.405+0000 7f9bdd26c640 1 -- 172.21.15.121:0/2786888187 >> v1:172.21.15.121:6789/0 conn(0x7f9bd809b470 legacy=0x7f9bd809b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:56.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.405+0000 7f9bdd26c640 1 -- 172.21.15.121:0/2786888187 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bd806d370 con 0x7f9bd8135c90 2024-09-16T07:33:56.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.405+0000 7f9bdca6b640 1 -- 172.21.15.121:0/2786888187 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1720833528 0 0) 0x7f9bd809f420 con 0x7f9bd809b470 2024-09-16T07:33:56.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.405+0000 7f9bdd26c640 1 --2- 172.21.15.121:0/2786888187 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9bd8135c90 0x7f9bd81380b0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20bbd6a3152218fe server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:56.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.405+0000 7f9bdca6b640 1 -- 172.21.15.121:0/2786888187 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9bcc009d90 con 0x7f9bd8135c90 2024-09-16T07:33:56.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.405+0000 7f9bdca6b640 1 -- 172.21.15.121:0/2786888187 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f9bcc00e230 con 0x7f9bd8135c90 2024-09-16T07:33:56.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.405+0000 7f9bdca6b640 1 -- 172.21.15.121:0/2786888187 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9bcc00e4d0 con 0x7f9bd8135c90 2024-09-16T07:33:56.407 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.406+0000 7f9bdfcd1640 1 -- 172.21.15.121:0/2786888187 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9bd8135c90 msgr2=0x7f9bd81380b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:56.407 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.406+0000 7f9bdfcd1640 1 --2- 172.21.15.121:0/2786888187 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9bd8135c90 0x7f9bd81380b0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:56.407 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.406+0000 7f9bdfcd1640 1 -- 172.21.15.121:0/2786888187 shutdown_connections 2024-09-16T07:33:56.407 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.406+0000 7f9bdfcd1640 1 --2- 172.21.15.121:0/2786888187 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9bd8135c90 0x7f9bd81380b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:56.407 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.406+0000 7f9bdfcd1640 1 -- 172.21.15.121:0/2786888187 >> 172.21.15.121:0/2786888187 conn(0x7f9bd80a32a0 msgr2=0x7f9bd80a36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:56.407 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.406+0000 7f9bdfcd1640 1 -- 172.21.15.121:0/2786888187 shutdown_connections 2024-09-16T07:33:56.407 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.406+0000 7f9bdfcd1640 1 -- 172.21.15.121:0/2786888187 wait complete. 2024-09-16T07:33:56.407 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.406+0000 7f9bdfcd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:56.407 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.408+0000 7f9bdfcd1640 1 Processor -- start 2024-09-16T07:33:56.407 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.408+0000 7f9bdfcd1640 1 -- start start 2024-09-16T07:33:56.409 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.409+0000 7f9bdfcd1640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9bd809b470 0x7f9bd8070580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:56.409 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.409+0000 7f9bdfcd1640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9bd809d8e0 con 0x7f9bd809b470 2024-09-16T07:33:56.409 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.409+0000 7f9bdda6d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9bd809b470 0x7f9bd8070580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:56.409 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.409+0000 7f9bdda6d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9bd809b470 0x7f9bd8070580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55434/0 (socket says 172.21.15.121:55434) 2024-09-16T07:33:56.409 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.409+0000 7f9bdda6d640 1 -- 172.21.15.121:0/79299015 learned_addr learned my addr 172.21.15.121:0/79299015 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:33:56.409 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.409+0000 7f9bdda6d640 1 -- 172.21.15.121:0/79299015 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bd8073100 con 0x7f9bd809b470 2024-09-16T07:33:56.409 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.409+0000 7f9bdda6d640 1 --2- 172.21.15.121:0/79299015 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9bd809b470 0x7f9bd8070580 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:56.409 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.409+0000 7f9bd67fc640 1 -- 172.21.15.121:0/79299015 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9bc8004bc0 con 0x7f9bd809b470 2024-09-16T07:33:56.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.409+0000 7f9bd67fc640 1 -- 172.21.15.121:0/79299015 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f9bc8004d20 con 0x7f9bd809b470 2024-09-16T07:33:56.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.409+0000 7f9bdfcd1640 1 -- 172.21.15.121:0/79299015 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bd8074a00 con 0x7f9bd809b470 2024-09-16T07:33:56.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.409+0000 7f9bd67fc640 1 -- 172.21.15.121:0/79299015 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9bc8007120 con 0x7f9bd809b470 2024-09-16T07:33:56.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.409+0000 7f9bdfcd1640 1 -- 172.21.15.121:0/79299015 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bd8134d80 con 0x7f9bd809b470 2024-09-16T07:33:56.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.410+0000 7f9bdfcd1640 1 -- 172.21.15.121:0/79299015 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bd809efd0 con 0x7f9bd809b470 2024-09-16T07:33:56.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.411+0000 7f9bd67fc640 1 -- 172.21.15.121:0/79299015 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f9bc80072d0 con 0x7f9bd809b470 2024-09-16T07:33:56.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.411+0000 7f9bd67fc640 1 --2- 172.21.15.121:0/79299015 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f9bc403e960 0x7f9bc4040e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:56.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.411+0000 7f9bd67fc640 1 -- 172.21.15.121:0/79299015 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7f9bc804ff60 con 0x7f9bd809b470 2024-09-16T07:33:56.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.411+0000 7f9bdd26c640 1 --2- 172.21.15.121:0/79299015 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f9bc403e960 0x7f9bc4040e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:56.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.412+0000 7f9bdd26c640 1 --2- 172.21.15.121:0/79299015 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f9bc403e960 0x7f9bc4040e70 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:56.415 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.416+0000 7f9bd67fc640 1 -- 172.21.15.121:0/79299015 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f9bc80066b0 con 0x7f9bd809b470 2024-09-16T07:33:56.636 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.637+0000 7f9bdfcd1640 1 -- 172.21.15.121:0/79299015 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f9bd806c3b0 con 0x7f9bd809b470 2024-09-16T07:33:56.638 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.639+0000 7f9bd67fc640 1 -- 172.21.15.121:0/79299015 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+97905 (crc 0 0 0) 0x7f9bc80060b0 con 0x7f9bd809b470 2024-09-16T07:33:56.639 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:33:56.641 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.641+0000 7f9bdfcd1640 1 -- 172.21.15.121:0/79299015 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f9bc403e960 msgr2=0x7f9bc4040e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:56.641 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.641+0000 7f9bdfcd1640 1 --2- 172.21.15.121:0/79299015 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f9bc403e960 0x7f9bc4040e70 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:56.641 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.641+0000 7f9bdfcd1640 1 -- 172.21.15.121:0/79299015 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9bd809b470 msgr2=0x7f9bd8070580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:56.641 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.641+0000 7f9bdfcd1640 1 --2- 172.21.15.121:0/79299015 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9bd809b470 0x7f9bd8070580 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:56.641 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.641+0000 7f9bdfcd1640 1 -- 172.21.15.121:0/79299015 shutdown_connections 2024-09-16T07:33:56.641 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.641+0000 7f9bdfcd1640 1 --2- 172.21.15.121:0/79299015 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f9bc403e960 0x7f9bc4040e70 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:56.641 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.641+0000 7f9bdfcd1640 1 --2- 172.21.15.121:0/79299015 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9bd809b470 0x7f9bd8070580 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:56.641 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.641+0000 7f9bdfcd1640 1 -- 172.21.15.121:0/79299015 >> 172.21.15.121:0/79299015 conn(0x7f9bd80a32a0 msgr2=0x7f9bd8068d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:56.641 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.641+0000 7f9bdfcd1640 1 -- 172.21.15.121:0/79299015 shutdown_connections 2024-09-16T07:33:56.641 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.641+0000 7f9bdfcd1640 1 -- 172.21.15.121:0/79299015 wait complete. 2024-09-16T07:33:56.651 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":5,"flags":0,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":643901738},{"type":"v1","addr":"172.21.15.172:6801","nonce":643901738}]},"active_addr":"172.21.15.172:6801/643901738","active_change":"2024-09-16T07:33:46.849820+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.172:0","nonce":3800803470}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.172:0","nonce":2555086449}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.172:0","nonce":2250663380}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.172:0","nonce":2561947132}]}]} 2024-09-16T07:33:56.654 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-16T07:33:56.654 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-16T07:33:56.654 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:33:56.762 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.759+0000 7f10aa06c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:56.762 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.763+0000 7f10aa06c640 1 Processor -- start 2024-09-16T07:33:56.762 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.763+0000 7f10aa06c640 1 -- start start 2024-09-16T07:33:56.764 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.764+0000 7f10aa06c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f10a409fa70 0x7f10a409fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:56.764 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.764+0000 7f10aa06c640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10a406f3a0 con 0x7f10a40a03c0 2024-09-16T07:33:56.765 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.765+0000 7f10aa06c640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f10a4074c20 con 0x7f10a409fa70 2024-09-16T07:33:56.765 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.765+0000 7f10a37fe640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f10a409fa70 0x7f10a409fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:56.765 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.765+0000 7f10a2ffd640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f10a40a03c0 0x7f10a413a200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:57406/0 (socket says 172.21.15.121:57406) 2024-09-16T07:33:56.765 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.765+0000 7f10a37fe640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f10a409fa70 0x7f10a409fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55436/0 (socket says 172.21.15.121:55436) 2024-09-16T07:33:56.765 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.765+0000 7f10a2ffd640 1 -- 172.21.15.121:0/3458414165 learned_addr learned my addr 172.21.15.121:0/3458414165 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-16T07:33:56.765 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.765+0000 7f10a37fe640 1 -- 172.21.15.121:0/3458414165 >> v1:172.21.15.121:6789/0 conn(0x7f10a40a03c0 legacy=0x7f10a413a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:56.765 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.765+0000 7f10a37fe640 1 -- 172.21.15.121:0/3458414165 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10a406f5d0 con 0x7f10a409fa70 2024-09-16T07:33:56.765 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.765+0000 7f10a27fc640 1 -- 172.21.15.121:0/3458414165 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2532739288 0 0) 0x7f10a406f3a0 con 0x7f10a40a03c0 2024-09-16T07:33:56.765 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.765+0000 7f10a37fe640 1 --2- 172.21.15.121:0/3458414165 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10a409fa70 0x7f10a409fe80 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9427a6d71dd8a2a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:56.765 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.765+0000 7f10a27fc640 1 -- 172.21.15.121:0/3458414165 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1094009d80 con 0x7f10a409fa70 2024-09-16T07:33:56.765 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.765+0000 7f10a27fc640 1 -- 172.21.15.121:0/3458414165 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f109400e230 con 0x7f10a409fa70 2024-09-16T07:33:56.765 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.765+0000 7f10a27fc640 1 -- 172.21.15.121:0/3458414165 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f109400e4d0 con 0x7f10a409fa70 2024-09-16T07:33:56.766 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.766+0000 7f10aa06c640 1 -- 172.21.15.121:0/3458414165 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10a409fa70 msgr2=0x7f10a409fe80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:56.766 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.766+0000 7f10aa06c640 1 --2- 172.21.15.121:0/3458414165 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10a409fa70 0x7f10a409fe80 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:56.766 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.766+0000 7f10aa06c640 1 -- 172.21.15.121:0/3458414165 shutdown_connections 2024-09-16T07:33:56.766 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.766+0000 7f10aa06c640 1 --2- 172.21.15.121:0/3458414165 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10a409fa70 0x7f10a409fe80 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:56.767 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.766+0000 7f10aa06c640 1 -- 172.21.15.121:0/3458414165 >> 172.21.15.121:0/3458414165 conn(0x7f10a40a33b0 msgr2=0x7f10a40a37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:56.767 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.766+0000 7f10aa06c640 1 -- 172.21.15.121:0/3458414165 shutdown_connections 2024-09-16T07:33:56.767 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.766+0000 7f10aa06c640 1 -- 172.21.15.121:0/3458414165 wait complete. 2024-09-16T07:33:56.767 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.766+0000 7f10aa06c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:56.767 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.768+0000 7f10aa06c640 1 Processor -- start 2024-09-16T07:33:56.767 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.768+0000 7f10aa06c640 1 -- start start 2024-09-16T07:33:56.768 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.769+0000 7f10aa06c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10a409fa70 0x7f10a41ab2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:56.769 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.769+0000 7f10aa06c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f10a41aa9a0 con 0x7f10a409fa70 2024-09-16T07:33:56.769 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.769+0000 7f10a37fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10a409fa70 0x7f10a41ab2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:56.769 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.769+0000 7f10a37fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10a409fa70 0x7f10a41ab2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55442/0 (socket says 172.21.15.121:55442) 2024-09-16T07:33:56.769 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.769+0000 7f10a37fe640 1 -- 172.21.15.121:0/2923644243 learned_addr learned my addr 172.21.15.121:0/2923644243 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:33:56.769 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.769+0000 7f10a37fe640 1 -- 172.21.15.121:0/2923644243 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10a41aaf30 con 0x7f10a409fa70 2024-09-16T07:33:56.769 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.769+0000 7f10a37fe640 1 --2- 172.21.15.121:0/2923644243 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10a409fa70 0x7f10a41ab2f0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:56.769 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.769+0000 7f108bfff640 1 -- 172.21.15.121:0/2923644243 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1094014620 con 0x7f10a409fa70 2024-09-16T07:33:56.769 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.769+0000 7f108bfff640 1 -- 172.21.15.121:0/2923644243 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1094014780 con 0x7f10a409fa70 2024-09-16T07:33:56.769 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.769+0000 7f10aa06c640 1 -- 172.21.15.121:0/2923644243 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10a41ac490 con 0x7f10a409fa70 2024-09-16T07:33:56.769 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.770+0000 7f108bfff640 1 -- 172.21.15.121:0/2923644243 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1094014a20 con 0x7f10a409fa70 2024-09-16T07:33:56.769 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.770+0000 7f10aa06c640 1 -- 172.21.15.121:0/2923644243 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10a41ae910 con 0x7f10a409fa70 2024-09-16T07:33:56.770 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.770+0000 7f10aa06c640 1 -- 172.21.15.121:0/2923644243 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10a409fe80 con 0x7f10a409fa70 2024-09-16T07:33:56.770 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.770+0000 7f108bfff640 1 -- 172.21.15.121:0/2923644243 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f1094014bd0 con 0x7f10a409fa70 2024-09-16T07:33:56.770 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.771+0000 7f108bfff640 1 --2- 172.21.15.121:0/2923644243 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f109003e960 0x7f1090040e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:56.771 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.771+0000 7f108bfff640 1 -- 172.21.15.121:0/2923644243 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7f1094019040 con 0x7f10a409fa70 2024-09-16T07:33:56.771 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.771+0000 7f10a2ffd640 1 --2- 172.21.15.121:0/2923644243 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f109003e960 0x7f1090040e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:56.771 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.772+0000 7f10a2ffd640 1 --2- 172.21.15.121:0/2923644243 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f109003e960 0x7f1090040e70 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:56.775 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.776+0000 7f108bfff640 1 -- 172.21.15.121:0/2923644243 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f1094011570 con 0x7f10a409fa70 2024-09-16T07:33:56.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.951+0000 7f10aa06c640 1 -- 172.21.15.121:0/2923644243 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f10a4078480 con 0x7f10a409fa70 2024-09-16T07:33:56.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.952+0000 7f108bfff640 1 -- 172.21.15.121:0/2923644243 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) ==== 74+0+8899 (crc 0 0 0) 0x7f109400f2a0 con 0x7f10a409fa70 2024-09-16T07:33:56.951 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:33:56.952 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":15,"fsid":"5b0c4070-0374-47d9-9f2a-f525ac27c89c","created":"2024-09-16T07:33:42.277188+0000","modified":"2024-09-16T07:33:55.944141+0000","last_up_change":"2024-09-16T07:33:49.860289+0000","last_in_change":"2024-09-16T07:33:44.410434+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:33:50.873314+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-16T07:33:52.616613+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ff74ae4d-122c-4c59-9a69-b559f9f27a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3193900849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6807","nonce":3193900849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":3193900849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6803","nonce":3193900849}]},"public_addr":"172.21.15.121:6808/3193900849","cluster_addr":"172.21.15.121:6807/3193900849","heartbeat_back_addr":"172.21.15.121:6804/3193900849","heartbeat_front_addr":"172.21.15.121:6803/3193900849","state":["exists","up"]},{"osd":1,"uuid":"0d1cdc37-865f-43c6-af56-0ca5fb928e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6801","nonce":4208564222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":4208564222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":4208564222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6805","nonce":4208564222}]},"public_addr":"172.21.15.121:6801/4208564222","cluster_addr":"172.21.15.121:6800/4208564222","heartbeat_back_addr":"172.21.15.121:6802/4208564222","heartbeat_front_addr":"172.21.15.121:6805/4208564222","state":["exists","up"]},{"osd":2,"uuid":"429c0781-5021-41da-8e0e-985110dcea52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2274906412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6803","nonce":2274906412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2274906412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2274906412}]},"public_addr":"172.21.15.172:6804/2274906412","cluster_addr":"172.21.15.172:6803/2274906412","heartbeat_back_addr":"172.21.15.172:6813/2274906412","heartbeat_front_addr":"172.21.15.172:6814/2274906412","state":["exists","up"]},{"osd":3,"uuid":"0ea1bce1-3795-403b-af2f-e62972443062","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3418488586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6807","nonce":3418488586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3418488586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3418488586}]},"public_addr":"172.21.15.172:6808/3418488586","cluster_addr":"172.21.15.172:6807/3418488586","heartbeat_back_addr":"172.21.15.172:6805/3418488586","heartbeat_front_addr":"172.21.15.172:6806/3418488586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:33:56.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.954+0000 7f10aa06c640 1 -- 172.21.15.121:0/2923644243 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f109003e960 msgr2=0x7f1090040e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:56.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.954+0000 7f10aa06c640 1 --2- 172.21.15.121:0/2923644243 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f109003e960 0x7f1090040e70 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:56.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.954+0000 7f10aa06c640 1 -- 172.21.15.121:0/2923644243 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10a409fa70 msgr2=0x7f10a41ab2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:56.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.954+0000 7f10aa06c640 1 --2- 172.21.15.121:0/2923644243 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10a409fa70 0x7f10a41ab2f0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:56.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.954+0000 7f10aa06c640 1 -- 172.21.15.121:0/2923644243 shutdown_connections 2024-09-16T07:33:56.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.954+0000 7f10aa06c640 1 --2- 172.21.15.121:0/2923644243 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f109003e960 0x7f1090040e70 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:56.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.954+0000 7f10aa06c640 1 --2- 172.21.15.121:0/2923644243 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10a409fa70 0x7f10a41ab2f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:56.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.954+0000 7f10aa06c640 1 -- 172.21.15.121:0/2923644243 >> 172.21.15.121:0/2923644243 conn(0x7f10a40a33b0 msgr2=0x7f10a41a3d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:56.955 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.955+0000 7f10aa06c640 1 -- 172.21.15.121:0/2923644243 shutdown_connections 2024-09-16T07:33:56.955 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:56.955+0000 7f10aa06c640 1 -- 172.21.15.121:0/2923644243 wait complete. 2024-09-16T07:33:56.965 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-16T07:33:56.965 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:33:57.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.069+0000 7fa0f2951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:57.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.074+0000 7fa0f2951640 1 Processor -- start 2024-09-16T07:33:57.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.074+0000 7fa0f2951640 1 -- start start 2024-09-16T07:33:57.075 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.075+0000 7fa0f2951640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa0ec068d40 0x7fa0ec069150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:57.075 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.075+0000 7fa0f2951640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0ec09d6b0 con 0x7fa0ec069690 2024-09-16T07:33:57.075 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.075+0000 7fa0f2951640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fa0ec09f6f0 con 0x7fa0ec068d40 2024-09-16T07:33:57.075 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.075+0000 7fa0ebfff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa0ec068d40 0x7fa0ec069150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:57.075 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.076+0000 7fa0ebfff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa0ec068d40 0x7fa0ec069150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55444/0 (socket says 172.21.15.121:55444) 2024-09-16T07:33:57.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.076+0000 7fa0eb7fe640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fa0ec069690 0x7fa0ec13a3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:57416/0 (socket says 172.21.15.121:57416) 2024-09-16T07:33:57.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.076+0000 7fa0ebfff640 1 -- 172.21.15.121:0/3153460763 learned_addr learned my addr 172.21.15.121:0/3153460763 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:33:57.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.076+0000 7fa0ebfff640 1 -- 172.21.15.121:0/3153460763 >> v1:172.21.15.121:6789/0 conn(0x7fa0ec069690 legacy=0x7fa0ec13a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:57.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.076+0000 7fa0ebfff640 1 -- 172.21.15.121:0/3153460763 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0ec06d370 con 0x7fa0ec068d40 2024-09-16T07:33:57.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.076+0000 7fa0eaffd640 1 -- 172.21.15.121:0/3153460763 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2535610578 0 0) 0x7fa0ec09d6b0 con 0x7fa0ec069690 2024-09-16T07:33:57.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.076+0000 7fa0ebfff640 1 --2- 172.21.15.121:0/3153460763 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa0ec068d40 0x7fa0ec069150 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dba5d49c59befc88 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:57.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.076+0000 7fa0eaffd640 1 -- 172.21.15.121:0/3153460763 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa0dc009e50 con 0x7fa0ec068d40 2024-09-16T07:33:57.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.076+0000 7fa0eaffd640 1 -- 172.21.15.121:0/3153460763 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa0dc00e230 con 0x7fa0ec068d40 2024-09-16T07:33:57.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.076+0000 7fa0eaffd640 1 -- 172.21.15.121:0/3153460763 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa0dc00e4d0 con 0x7fa0ec068d40 2024-09-16T07:33:57.077 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.077+0000 7fa0f2951640 1 -- 172.21.15.121:0/3153460763 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa0ec068d40 msgr2=0x7fa0ec069150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:57.077 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.077+0000 7fa0f2951640 1 --2- 172.21.15.121:0/3153460763 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa0ec068d40 0x7fa0ec069150 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:57.077 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.077+0000 7fa0f2951640 1 -- 172.21.15.121:0/3153460763 shutdown_connections 2024-09-16T07:33:57.077 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.077+0000 7fa0f2951640 1 --2- 172.21.15.121:0/3153460763 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa0ec068d40 0x7fa0ec069150 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:57.077 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.077+0000 7fa0f2951640 1 -- 172.21.15.121:0/3153460763 >> 172.21.15.121:0/3153460763 conn(0x7fa0ec0a32a0 msgr2=0x7fa0ec0a36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:57.077 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.077+0000 7fa0f2951640 1 -- 172.21.15.121:0/3153460763 shutdown_connections 2024-09-16T07:33:57.077 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.077+0000 7fa0f2951640 1 -- 172.21.15.121:0/3153460763 wait complete. 2024-09-16T07:33:57.077 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.077+0000 7fa0f2951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:57.078 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.078+0000 7fa0f2951640 1 Processor -- start 2024-09-16T07:33:57.078 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.079+0000 7fa0f2951640 1 -- start start 2024-09-16T07:33:57.079 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.080+0000 7fa0f2951640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa0ec068d40 0x7fa0ec1cad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:57.079 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.080+0000 7fa0f2951640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa0ec09a400 con 0x7fa0ec068d40 2024-09-16T07:33:57.080 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.080+0000 7fa0ebfff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa0ec068d40 0x7fa0ec1cad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:57.080 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.080+0000 7fa0ebfff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa0ec068d40 0x7fa0ec1cad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55452/0 (socket says 172.21.15.121:55452) 2024-09-16T07:33:57.080 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.080+0000 7fa0ebfff640 1 -- 172.21.15.121:0/3316470182 learned_addr learned my addr 172.21.15.121:0/3316470182 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:33:57.080 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.080+0000 7fa0ebfff640 1 -- 172.21.15.121:0/3316470182 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0ec0996a0 con 0x7fa0ec068d40 2024-09-16T07:33:57.080 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.080+0000 7fa0ebfff640 1 --2- 172.21.15.121:0/3316470182 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa0ec068d40 0x7fa0ec1cad80 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:57.080 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.080+0000 7fa0e8ff9640 1 -- 172.21.15.121:0/3316470182 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa0dc00eda0 con 0x7fa0ec068d40 2024-09-16T07:33:57.080 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.080+0000 7fa0e8ff9640 1 -- 172.21.15.121:0/3316470182 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa0dc015420 con 0x7fa0ec068d40 2024-09-16T07:33:57.080 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.080+0000 7fa0f2951640 1 -- 172.21.15.121:0/3316470182 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0ec09a5b0 con 0x7fa0ec068d40 2024-09-16T07:33:57.080 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.080+0000 7fa0e8ff9640 1 -- 172.21.15.121:0/3316470182 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa0dc0156c0 con 0x7fa0ec068d40 2024-09-16T07:33:57.080 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.080+0000 7fa0f2951640 1 -- 172.21.15.121:0/3316470182 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0ec09b7d0 con 0x7fa0ec068d40 2024-09-16T07:33:57.081 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.081+0000 7fa0f2951640 1 -- 172.21.15.121:0/3316470182 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0ec077260 con 0x7fa0ec068d40 2024-09-16T07:33:57.081 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.081+0000 7fa0e8ff9640 1 -- 172.21.15.121:0/3316470182 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fa0dc015870 con 0x7fa0ec068d40 2024-09-16T07:33:57.081 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.082+0000 7fa0e8ff9640 1 --2- 172.21.15.121:0/3316470182 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fa0d803e930 0x7fa0d8040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:57.081 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.082+0000 7fa0e8ff9640 1 -- 172.21.15.121:0/3316470182 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7fa0dc050c00 con 0x7fa0ec068d40 2024-09-16T07:33:57.081 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.082+0000 7fa0eb7fe640 1 --2- 172.21.15.121:0/3316470182 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fa0d803e930 0x7fa0d8040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:57.082 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.083+0000 7fa0eb7fe640 1 --2- 172.21.15.121:0/3316470182 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fa0d803e930 0x7fa0d8040e40 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:57.086 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.087+0000 7fa0e8ff9640 1 -- 172.21.15.121:0/3316470182 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fa0dc00f2a0 con 0x7fa0ec068d40 2024-09-16T07:33:57.260 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.261+0000 7fa0f2951640 1 -- 172.21.15.121:0/3316470182 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa0ec099060 con 0x7fa0ec068d40 2024-09-16T07:33:57.261 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.262+0000 7fa0e8ff9640 1 -- 172.21.15.121:0/3316470182 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) ==== 74+0+8899 (crc 0 0 0) 0x7fa0dc0059f0 con 0x7fa0ec068d40 2024-09-16T07:33:57.261 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:33:57.261 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":15,"fsid":"5b0c4070-0374-47d9-9f2a-f525ac27c89c","created":"2024-09-16T07:33:42.277188+0000","modified":"2024-09-16T07:33:55.944141+0000","last_up_change":"2024-09-16T07:33:49.860289+0000","last_in_change":"2024-09-16T07:33:44.410434+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:33:50.873314+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-16T07:33:52.616613+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ff74ae4d-122c-4c59-9a69-b559f9f27a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3193900849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6807","nonce":3193900849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":3193900849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6803","nonce":3193900849}]},"public_addr":"172.21.15.121:6808/3193900849","cluster_addr":"172.21.15.121:6807/3193900849","heartbeat_back_addr":"172.21.15.121:6804/3193900849","heartbeat_front_addr":"172.21.15.121:6803/3193900849","state":["exists","up"]},{"osd":1,"uuid":"0d1cdc37-865f-43c6-af56-0ca5fb928e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6801","nonce":4208564222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":4208564222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":4208564222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6805","nonce":4208564222}]},"public_addr":"172.21.15.121:6801/4208564222","cluster_addr":"172.21.15.121:6800/4208564222","heartbeat_back_addr":"172.21.15.121:6802/4208564222","heartbeat_front_addr":"172.21.15.121:6805/4208564222","state":["exists","up"]},{"osd":2,"uuid":"429c0781-5021-41da-8e0e-985110dcea52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2274906412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6803","nonce":2274906412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2274906412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2274906412}]},"public_addr":"172.21.15.172:6804/2274906412","cluster_addr":"172.21.15.172:6803/2274906412","heartbeat_back_addr":"172.21.15.172:6813/2274906412","heartbeat_front_addr":"172.21.15.172:6814/2274906412","state":["exists","up"]},{"osd":3,"uuid":"0ea1bce1-3795-403b-af2f-e62972443062","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3418488586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6807","nonce":3418488586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3418488586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3418488586}]},"public_addr":"172.21.15.172:6808/3418488586","cluster_addr":"172.21.15.172:6807/3418488586","heartbeat_back_addr":"172.21.15.172:6805/3418488586","heartbeat_front_addr":"172.21.15.172:6806/3418488586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:33:57.264 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.264+0000 7fa0f2951640 1 -- 172.21.15.121:0/3316470182 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fa0d803e930 msgr2=0x7fa0d8040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:57.264 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.264+0000 7fa0f2951640 1 --2- 172.21.15.121:0/3316470182 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fa0d803e930 0x7fa0d8040e40 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:57.264 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.264+0000 7fa0f2951640 1 -- 172.21.15.121:0/3316470182 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa0ec068d40 msgr2=0x7fa0ec1cad80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:57.264 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.264+0000 7fa0f2951640 1 --2- 172.21.15.121:0/3316470182 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa0ec068d40 0x7fa0ec1cad80 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:57.264 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.264+0000 7fa0f2951640 1 -- 172.21.15.121:0/3316470182 shutdown_connections 2024-09-16T07:33:57.264 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.264+0000 7fa0f2951640 1 --2- 172.21.15.121:0/3316470182 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fa0d803e930 0x7fa0d8040e40 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:57.264 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.264+0000 7fa0f2951640 1 --2- 172.21.15.121:0/3316470182 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa0ec068d40 0x7fa0ec1cad80 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:57.264 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.264+0000 7fa0f2951640 1 -- 172.21.15.121:0/3316470182 >> 172.21.15.121:0/3316470182 conn(0x7fa0ec0a32a0 msgr2=0x7fa0ec090d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:57.264 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.264+0000 7fa0f2951640 1 -- 172.21.15.121:0/3316470182 shutdown_connections 2024-09-16T07:33:57.265 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.264+0000 7fa0f2951640 1 -- 172.21.15.121:0/3316470182 wait complete. 2024-09-16T07:33:57.275 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-16T07:33:57.276 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-16T07:33:57.276 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-16T07:33:57.277 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-16T07:33:57.395 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.390+0000 7f0ff6751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:57.395 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.390+0000 7f6fef4d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:57.395 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.390+0000 7fedb30a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:57.396 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.391+0000 7f058346c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:57.396 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.396+0000 7f6fef4d1640 1 Processor -- start 2024-09-16T07:33:57.396 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.396+0000 7fedb30a3640 1 Processor -- start 2024-09-16T07:33:57.397 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.396+0000 7f058346c640 1 Processor -- start 2024-09-16T07:33:57.397 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.397+0000 7fedb30a3640 1 -- start start 2024-09-16T07:33:57.397 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.397+0000 7f0ff6751640 1 Processor -- start 2024-09-16T07:33:57.398 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.397+0000 7f6fef4d1640 1 -- start start 2024-09-16T07:33:57.398 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.397+0000 7f0ff6751640 1 -- start start 2024-09-16T07:33:57.399 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.397+0000 7f058346c640 1 -- start start 2024-09-16T07:33:57.399 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.398+0000 7f6fef4d1640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f6fe8135570 0x7f6fe8137990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:57.400 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.398+0000 7f0ff6751640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f0ff009d570 0x7f0ff013b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:57.400 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.398+0000 7f0ff6751640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ff00a0060 con 0x7f0ff009ca50 2024-09-16T07:33:57.400 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.398+0000 7f0ff6751640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f0ff009fd30 con 0x7f0ff009d570 2024-09-16T07:33:57.401 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.398+0000 7f058346c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f057c09e620 0x7f057c139490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:57.401 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.398+0000 7f6fef4d1640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fe8098840 con 0x7f6fe8132790 2024-09-16T07:33:57.401 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.398+0000 7f6fef4d1640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f6fe809ac90 con 0x7f6fe8135570 2024-09-16T07:33:57.401 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.398+0000 7f6feca6c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f6fe8135570 0x7f6fe8137990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:57.402 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.398+0000 7f058346c640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f057c09ed40 con 0x7f057c09db00 2024-09-16T07:33:57.402 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.398+0000 7f6feca6c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f6fe8135570 0x7f6fe8137990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55468/0 (socket says 172.21.15.121:55468) 2024-09-16T07:33:57.402 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.398+0000 7f058346c640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f057c09ea30 con 0x7f057c09e620 2024-09-16T07:33:57.403 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.398+0000 7f6feca6c640 1 -- 172.21.15.121:0/1782219686 learned_addr learned my addr 172.21.15.121:0/1782219686 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:33:57.403 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.398+0000 7f0fef7fe640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f0ff009d570 0x7f0ff013b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:57.403 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.398+0000 7f0feffff640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f0ff009ca50 0x7f0ff009ce60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:57448/0 (socket says 172.21.15.121:57448) 2024-09-16T07:33:57.403 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.398+0000 7f0feffff640 1 -- 172.21.15.121:0/2357469621 learned_addr learned my addr 172.21.15.121:0/2357469621 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-16T07:33:57.404 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.398+0000 7fedb30a3640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fedac069860 0x7fedac13b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:57.404 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.398+0000 7fedabfff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fedac069860 0x7fedac13b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:57.404 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.398+0000 7fedabfff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fedac069860 0x7fedac13b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55494/0 (socket says 172.21.15.121:55494) 2024-09-16T07:33:57.404 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.398+0000 7fedabfff640 1 -- 172.21.15.121:0/3736347962 learned_addr learned my addr 172.21.15.121:0/3736347962 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:33:57.404 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.398+0000 7fedb30a3640 1 -- 172.21.15.121:0/3736347962 --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedac09d6b0 con 0x7fedac068d40 2024-09-16T07:33:57.404 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.398+0000 7fedb30a3640 1 -- 172.21.15.121:0/3736347962 --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fedac09f6f0 con 0x7fedac069860 2024-09-16T07:33:57.404 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.398+0000 7f0580a07640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f057c09e620 0x7f057c139490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:57.404 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.398+0000 7f0580a07640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f057c09e620 0x7f057c139490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55510/0 (socket says 172.21.15.121:55510) 2024-09-16T07:33:57.404 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.398+0000 7f0580a07640 1 -- 172.21.15.121:0/1452743954 learned_addr learned my addr 172.21.15.121:0/1452743954 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:33:57.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.398+0000 7f6feca6c640 1 -- 172.21.15.121:0/1782219686 >> v1:172.21.15.121:6789/0 conn(0x7f6fe8132790 legacy=0x7f6fe8132ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:57.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.398+0000 7f6feca6c640 1 -- 172.21.15.121:0/1782219686 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fe809cb70 con 0x7f6fe8135570 2024-09-16T07:33:57.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.399+0000 7f0fef7fe640 1 -- 172.21.15.121:0/2357469621 >> v1:172.21.15.121:6789/0 conn(0x7f0ff009ca50 legacy=0x7f0ff009ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:57.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.399+0000 7f0fef7fe640 1 -- 172.21.15.121:0/2357469621 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ff009e3c0 con 0x7f0ff009d570 2024-09-16T07:33:57.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.399+0000 7fedabfff640 1 -- 172.21.15.121:0/3736347962 >> v1:172.21.15.121:6789/0 conn(0x7fedac068d40 legacy=0x7fedac069150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:57.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.399+0000 7fedabfff640 1 -- 172.21.15.121:0/3736347962 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedac06d370 con 0x7fedac069860 2024-09-16T07:33:57.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.399+0000 7f0580a07640 1 -- 172.21.15.121:0/1452743954 >> v1:172.21.15.121:6789/0 conn(0x7f057c09db00 legacy=0x7f057c09df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:57.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.399+0000 7f0580a07640 1 -- 172.21.15.121:0/1452743954 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f057c0a0700 con 0x7f057c09e620 2024-09-16T07:33:57.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.399+0000 7fedabfff640 1 --2- 172.21.15.121:0/3736347962 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fedac069860 0x7fedac13b3b0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32863c75cbbe933c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:57.407 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.399+0000 7f6feca6c640 1 --2- 172.21.15.121:0/1782219686 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6fe8135570 0x7f6fe8137990 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1478c1d5b618e083 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:57.407 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.399+0000 7f0fef7fe640 1 --2- 172.21.15.121:0/2357469621 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ff009d570 0x7f0ff013b3b0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb1b8a4c2dbef353 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:57.407 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.399+0000 7f0580a07640 1 --2- 172.21.15.121:0/1452743954 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f057c09e620 0x7f057c139490 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99814dfc0a4ae7d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:57.407 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.399+0000 7f6fdffff640 1 -- 172.21.15.121:0/1782219686 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6fd8009e40 con 0x7f6fe8135570 2024-09-16T07:33:57.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.399+0000 7fedab7fe640 1 -- 172.21.15.121:0/3736347962 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fed98009e50 con 0x7fedac069860 2024-09-16T07:33:57.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.399+0000 7fedab7fe640 1 -- 172.21.15.121:0/3736347962 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fed9800e230 con 0x7fedac069860 2024-09-16T07:33:57.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.399+0000 7fedab7fe640 1 -- 172.21.15.121:0/3736347962 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fed9800e4d0 con 0x7fedac069860 2024-09-16T07:33:57.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.399+0000 7f6fdffff640 1 -- 172.21.15.121:0/1782219686 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f6fd800e230 con 0x7f6fe8135570 2024-09-16T07:33:57.409 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.399+0000 7f6fdffff640 1 -- 172.21.15.121:0/1782219686 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6fd800e4d0 con 0x7f6fe8135570 2024-09-16T07:33:57.409 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.399+0000 7f0feeffd640 1 -- 172.21.15.121:0/2357469621 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0fe4009d80 con 0x7f0ff009d570 2024-09-16T07:33:57.409 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.399+0000 7f0573fff640 1 -- 172.21.15.121:0/1452743954 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f056c009e40 con 0x7f057c09e620 2024-09-16T07:33:57.409 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.399+0000 7f0feeffd640 1 -- 172.21.15.121:0/2357469621 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0fe400e230 con 0x7f0ff009d570 2024-09-16T07:33:57.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.399+0000 7f0573fff640 1 -- 172.21.15.121:0/1452743954 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f056c00e230 con 0x7f057c09e620 2024-09-16T07:33:57.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.399+0000 7f0feeffd640 1 -- 172.21.15.121:0/2357469621 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0fe400e4d0 con 0x7f0ff009d570 2024-09-16T07:33:57.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.399+0000 7f0573fff640 1 -- 172.21.15.121:0/1452743954 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f056c00e4d0 con 0x7f057c09e620 2024-09-16T07:33:57.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.400+0000 7fedb30a3640 1 -- 172.21.15.121:0/3736347962 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fedac069860 msgr2=0x7fedac13b3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:57.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.400+0000 7fedb30a3640 1 --2- 172.21.15.121:0/3736347962 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fedac069860 0x7fedac13b3b0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:57.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.400+0000 7f6fef4d1640 1 -- 172.21.15.121:0/1782219686 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6fe8135570 msgr2=0x7f6fe8137990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:57.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.400+0000 7f6fef4d1640 1 --2- 172.21.15.121:0/1782219686 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6fe8135570 0x7f6fe8137990 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:57.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.400+0000 7fedb30a3640 1 -- 172.21.15.121:0/3736347962 shutdown_connections 2024-09-16T07:33:57.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.400+0000 7fedb30a3640 1 --2- 172.21.15.121:0/3736347962 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fedac069860 0x7fedac13b3b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:57.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.400+0000 7fedb30a3640 1 -- 172.21.15.121:0/3736347962 >> 172.21.15.121:0/3736347962 conn(0x7fedac0a32a0 msgr2=0x7fedac0a36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:57.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.400+0000 7f0ff6751640 1 -- 172.21.15.121:0/2357469621 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ff009d570 msgr2=0x7f0ff013b3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:57.413 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.400+0000 7f0ff6751640 1 --2- 172.21.15.121:0/2357469621 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ff009d570 0x7f0ff013b3b0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:57.413 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.400+0000 7f6fef4d1640 1 -- 172.21.15.121:0/1782219686 shutdown_connections 2024-09-16T07:33:57.413 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.400+0000 7f0ff6751640 1 -- 172.21.15.121:0/2357469621 shutdown_connections 2024-09-16T07:33:57.413 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.400+0000 7f0ff6751640 1 --2- 172.21.15.121:0/2357469621 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ff009d570 0x7f0ff013b3b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:57.413 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.400+0000 7f0ff6751640 1 -- 172.21.15.121:0/2357469621 >> 172.21.15.121:0/2357469621 conn(0x7f0ff00a5230 msgr2=0x7f0ff00a5640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:57.414 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.400+0000 7f6fef4d1640 1 --2- 172.21.15.121:0/1782219686 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6fe8135570 0x7f6fe8137990 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:57.414 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.400+0000 7fedb30a3640 1 -- 172.21.15.121:0/3736347962 shutdown_connections 2024-09-16T07:33:57.414 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.400+0000 7f6fef4d1640 1 -- 172.21.15.121:0/1782219686 >> 172.21.15.121:0/1782219686 conn(0x7f6fe80a11f0 msgr2=0x7f6fe80a1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:57.414 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.400+0000 7f0ff6751640 1 -- 172.21.15.121:0/2357469621 shutdown_connections 2024-09-16T07:33:57.415 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.400+0000 7f0ff6751640 1 -- 172.21.15.121:0/2357469621 wait complete. 2024-09-16T07:33:57.415 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.400+0000 7fedb30a3640 1 -- 172.21.15.121:0/3736347962 wait complete. 2024-09-16T07:33:57.415 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.400+0000 7f058346c640 1 -- 172.21.15.121:0/1452743954 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f057c09e620 msgr2=0x7f057c139490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:57.415 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.400+0000 7f6fef4d1640 1 -- 172.21.15.121:0/1782219686 shutdown_connections 2024-09-16T07:33:57.416 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.400+0000 7f058346c640 1 --2- 172.21.15.121:0/1452743954 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f057c09e620 0x7f057c139490 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:57.416 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.400+0000 7f6fef4d1640 1 -- 172.21.15.121:0/1782219686 wait complete. 2024-09-16T07:33:57.416 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.401+0000 7f0ff6751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:57.417 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.401+0000 7fedb30a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:57.417 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.401+0000 7f058346c640 1 -- 172.21.15.121:0/1452743954 shutdown_connections 2024-09-16T07:33:57.417 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.401+0000 7f058346c640 1 --2- 172.21.15.121:0/1452743954 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f057c09e620 0x7f057c139490 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:57.417 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.401+0000 7f058346c640 1 -- 172.21.15.121:0/1452743954 >> 172.21.15.121:0/1452743954 conn(0x7f057c0a45b0 msgr2=0x7f057c0a49c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:57.418 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.401+0000 7f6fef4d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:57.418 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.401+0000 7f058346c640 1 -- 172.21.15.121:0/1452743954 shutdown_connections 2024-09-16T07:33:57.418 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.401+0000 7f058346c640 1 -- 172.21.15.121:0/1452743954 wait complete. 2024-09-16T07:33:57.418 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.402+0000 7f058346c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:57.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.402+0000 7f6fef4d1640 1 Processor -- start 2024-09-16T07:33:57.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.402+0000 7fedb30a3640 1 Processor -- start 2024-09-16T07:33:57.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.402+0000 7f6fef4d1640 1 -- start start 2024-09-16T07:33:57.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.402+0000 7fedb30a3640 1 -- start start 2024-09-16T07:33:57.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.402+0000 7f0ff6751640 1 Processor -- start 2024-09-16T07:33:57.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.403+0000 7f0ff6751640 1 -- start start 2024-09-16T07:33:57.421 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.403+0000 7f6fef4d1640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6fe8132790 0x7f6fe806efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:57.421 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.403+0000 7f6fef4d1640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6fe8139740 con 0x7f6fe8132790 2024-09-16T07:33:57.421 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.403+0000 7f6fed26d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6fe8132790 0x7f6fe806efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:57.421 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.403+0000 7f6fed26d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6fe8132790 0x7f6fe806efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55516/0 (socket says 172.21.15.121:55516) 2024-09-16T07:33:57.421 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.403+0000 7f6fed26d640 1 -- 172.21.15.121:0/2758086991 learned_addr learned my addr 172.21.15.121:0/2758086991 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:33:57.421 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.404+0000 7f6fed26d640 1 -- 172.21.15.121:0/2758086991 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fe8071030 con 0x7f6fe8132790 2024-09-16T07:33:57.422 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.404+0000 7fedb30a3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fedac068d40 0x7fedac1b8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:57.422 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.404+0000 7fedb30a3640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fedac1b77a0 con 0x7fedac068d40 2024-09-16T07:33:57.422 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.404+0000 7fedb0e3f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fedac068d40 0x7fedac1b8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:57.422 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.404+0000 7fedb0e3f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fedac068d40 0x7fedac1b8ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55532/0 (socket says 172.21.15.121:55532) 2024-09-16T07:33:57.422 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.404+0000 7fedb0e3f640 1 -- 172.21.15.121:0/2895038226 learned_addr learned my addr 172.21.15.121:0/2895038226 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:33:57.422 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.404+0000 7f058346c640 1 Processor -- start 2024-09-16T07:33:57.423 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.404+0000 7f6fed26d640 1 --2- 172.21.15.121:0/2758086991 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6fe8132790 0x7f6fe806efd0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:57.423 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.404+0000 7f058346c640 1 -- start start 2024-09-16T07:33:57.423 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.404+0000 7fedb0e3f640 1 -- 172.21.15.121:0/2895038226 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedac1ba8d0 con 0x7fedac068d40 2024-09-16T07:33:57.424 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.404+0000 7f6fddffb640 1 -- 172.21.15.121:0/2758086991 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6fe400c890 con 0x7f6fe8132790 2024-09-16T07:33:57.424 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.405+0000 7f6fddffb640 1 -- 172.21.15.121:0/2758086991 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f6fe400c9f0 con 0x7f6fe8132790 2024-09-16T07:33:57.424 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.405+0000 7f6fef4d1640 1 -- 172.21.15.121:0/2758086991 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fe80712f0 con 0x7f6fe8132790 2024-09-16T07:33:57.424 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.405+0000 7fedb0e3f640 1 --2- 172.21.15.121:0/2895038226 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fedac068d40 0x7fedac1b8ed0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:57.424 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.405+0000 7f6fddffb640 1 -- 172.21.15.121:0/2758086991 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6fe400cc90 con 0x7f6fe8132790 2024-09-16T07:33:57.425 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.405+0000 7f0ff6751640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ff009ca50 0x7f0ff0122d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:57.425 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.405+0000 7f0ff6751640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0ff0124200 con 0x7f0ff009ca50 2024-09-16T07:33:57.425 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.405+0000 7feda97fa640 1 -- 172.21.15.121:0/2895038226 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7feda000c850 con 0x7fedac068d40 2024-09-16T07:33:57.425 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.405+0000 7f6fef4d1640 1 -- 172.21.15.121:0/2758086991 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fe8133c90 con 0x7f6fe8132790 2024-09-16T07:33:57.426 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.405+0000 7feda97fa640 1 -- 172.21.15.121:0/2895038226 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7feda000c9b0 con 0x7fedac068d40 2024-09-16T07:33:57.426 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.405+0000 7feda97fa640 1 -- 172.21.15.121:0/2895038226 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7feda000cc50 con 0x7fedac068d40 2024-09-16T07:33:57.426 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.405+0000 7f0feffff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ff009ca50 0x7f0ff0122d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:57.427 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.405+0000 7f0feffff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ff009ca50 0x7f0ff0122d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55538/0 (socket says 172.21.15.121:55538) 2024-09-16T07:33:57.427 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.405+0000 7f0feffff640 1 -- 172.21.15.121:0/2687512691 learned_addr learned my addr 172.21.15.121:0/2687512691 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:33:57.427 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.405+0000 7fedb30a3640 1 -- 172.21.15.121:0/2895038226 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedac1b8c30 con 0x7fedac068d40 2024-09-16T07:33:57.427 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.406+0000 7f6fef4d1640 1 -- 172.21.15.121:0/2758086991 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6fe809bff0 con 0x7f6fe8132790 2024-09-16T07:33:57.427 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.406+0000 7fedb30a3640 1 -- 172.21.15.121:0/2895038226 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedac1b6790 con 0x7fedac068d40 2024-09-16T07:33:57.428 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.406+0000 7f058346c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f057c09db00 0x7f057c12d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:57.428 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.406+0000 7f058346c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f057c12f200 con 0x7f057c09db00 2024-09-16T07:33:57.428 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.406+0000 7f0feffff640 1 -- 172.21.15.121:0/2687512691 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ff0126ce0 con 0x7f0ff009ca50 2024-09-16T07:33:57.429 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.406+0000 7f0581208640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f057c09db00 0x7f057c12d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:57.429 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.406+0000 7f0581208640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f057c09db00 0x7f057c12d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55544/0 (socket says 172.21.15.121:55544) 2024-09-16T07:33:57.429 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.406+0000 7f0581208640 1 -- 172.21.15.121:0/4118542684 learned_addr learned my addr 172.21.15.121:0/4118542684 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:33:57.429 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.406+0000 7f0581208640 1 -- 172.21.15.121:0/4118542684 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f057c12d2e0 con 0x7f057c09db00 2024-09-16T07:33:57.429 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.407+0000 7f0581208640 1 --2- 172.21.15.121:0/4118542684 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f057c09db00 0x7f057c12d6a0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:57.429 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.407+0000 7f0feffff640 1 --2- 172.21.15.121:0/2687512691 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ff009ca50 0x7f0ff0122d60 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:57.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.407+0000 7fedb30a3640 1 -- 172.21.15.121:0/2895038226 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fedac09cb40 con 0x7fedac068d40 2024-09-16T07:33:57.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.407+0000 7f0571ffb640 1 -- 172.21.15.121:0/4118542684 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0578001b90 con 0x7f057c09db00 2024-09-16T07:33:57.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.407+0000 7f0571ffb640 1 -- 172.21.15.121:0/4118542684 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0578001cf0 con 0x7f057c09db00 2024-09-16T07:33:57.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.407+0000 7f6fddffb640 1 -- 172.21.15.121:0/2758086991 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f6fe4012380 con 0x7f6fe8132790 2024-09-16T07:33:57.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.407+0000 7f0571ffb640 1 -- 172.21.15.121:0/4118542684 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0578013250 con 0x7f057c09db00 2024-09-16T07:33:57.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.407+0000 7f0fecff9640 1 -- 172.21.15.121:0/2687512691 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0fe0005a60 con 0x7f0ff009ca50 2024-09-16T07:33:57.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.407+0000 7f058346c640 1 -- 172.21.15.121:0/4118542684 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f057c1376b0 con 0x7f057c09db00 2024-09-16T07:33:57.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.407+0000 7f0fecff9640 1 -- 172.21.15.121:0/2687512691 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0fe0005bc0 con 0x7f0ff009ca50 2024-09-16T07:33:57.432 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.407+0000 7f0ff6751640 1 -- 172.21.15.121:0/2687512691 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ff01269b0 con 0x7f0ff009ca50 2024-09-16T07:33:57.432 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.407+0000 7f058346c640 1 -- 172.21.15.121:0/4118542684 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f057c130cf0 con 0x7f057c09db00 2024-09-16T07:33:57.432 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.407+0000 7f0fecff9640 1 -- 172.21.15.121:0/2687512691 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0fe0005e60 con 0x7f0ff009ca50 2024-09-16T07:33:57.432 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.407+0000 7f6fddffb640 1 --2- 172.21.15.121:0/2758086991 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f6fcc03e9d0 0x7f6fcc040ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:57.433 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.407+0000 7f0ff6751640 1 -- 172.21.15.121:0/2687512691 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ff0126610 con 0x7f0ff009ca50 2024-09-16T07:33:57.433 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.407+0000 7f6fddffb640 1 -- 172.21.15.121:0/2758086991 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7f6fe40500d0 con 0x7f6fe8132790 2024-09-16T07:33:57.433 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.408+0000 7f6fddffb640 1 --2- 172.21.15.121:0/2758086991 >> v2:172.21.15.121:6808/3193900849 conn(0x7f6fcc043b00 0x7f6fcc045fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:57.433 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.408+0000 7f6feca6c640 1 --2- 172.21.15.121:0/2758086991 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f6fcc03e9d0 0x7f6fcc040ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:57.434 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.407+0000 7feda97fa640 1 -- 172.21.15.121:0/2895038226 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7feda0011310 con 0x7fedac068d40 2024-09-16T07:33:57.434 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.408+0000 7feda97fa640 1 --2- 172.21.15.121:0/2895038226 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fed9003e980 0x7fed90040e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:57.434 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.408+0000 7feda97fa640 1 -- 172.21.15.121:0/2895038226 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7feda004fe50 con 0x7fedac068d40 2024-09-16T07:33:57.434 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.408+0000 7feda97fa640 1 --2- 172.21.15.121:0/2895038226 >> v2:172.21.15.121:6801/4208564222 conn(0x7fed90043980 0x7fed90045e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:57.434 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.408+0000 7feda97fa640 1 -- 172.21.15.121:0/2895038226 --> v2:172.21.15.121:6801/4208564222 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fed900464e0 con 0x7fed90043980 2024-09-16T07:33:57.435 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.408+0000 7f058346c640 1 -- 172.21.15.121:0/4118542684 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f057c09bcf0 con 0x7f057c09db00 2024-09-16T07:33:57.435 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.408+0000 7fedabfff640 1 --2- 172.21.15.121:0/2895038226 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fed9003e980 0x7fed90040e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:57.435 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.408+0000 7f0ff6751640 1 -- 172.21.15.121:0/2687512691 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0ff009f9b0 con 0x7f0ff009ca50 2024-09-16T07:33:57.435 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.408+0000 7feda97fa640 1 -- 172.21.15.121:0/2895038226 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (crc 0 0 0) 0x7feda0011610 con 0x7fedac068d40 2024-09-16T07:33:57.436 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.408+0000 7f6fddffb640 1 -- 172.21.15.121:0/2758086991 --> v2:172.21.15.121:6808/3193900849 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6fcc046660 con 0x7f6fcc043b00 2024-09-16T07:33:57.436 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.408+0000 7f6fddffb640 1 -- 172.21.15.121:0/2758086991 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (crc 0 0 0) 0x7f6fe40503e0 con 0x7f6fe8132790 2024-09-16T07:33:57.436 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.409+0000 7f0571ffb640 1 -- 172.21.15.121:0/4118542684 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f0578013450 con 0x7f057c09db00 2024-09-16T07:33:57.436 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.409+0000 7f6feca6c640 1 --2- 172.21.15.121:0/2758086991 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f6fcc03e9d0 0x7f6fcc040ee0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:57.437 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.409+0000 7f0571ffb640 1 --2- 172.21.15.121:0/4118542684 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f056003e930 0x7f0560040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:57.437 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.409+0000 7f0571ffb640 1 -- 172.21.15.121:0/4118542684 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7f0578015040 con 0x7f057c09db00 2024-09-16T07:33:57.437 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.409+0000 7f0571ffb640 1 --2- 172.21.15.121:0/4118542684 >> v2:172.21.15.172:6804/2274906412 conn(0x7f0560043930 0x7f0560045e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:57.437 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.409+0000 7f0571ffb640 1 -- 172.21.15.121:0/4118542684 --> v2:172.21.15.172:6804/2274906412 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0560046490 con 0x7f0560043930 2024-09-16T07:33:57.437 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.409+0000 7fedb1640640 1 --2- 172.21.15.121:0/2895038226 >> v2:172.21.15.121:6801/4208564222 conn(0x7fed90043980 0x7fed90045e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T07:33:57.437 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.409+0000 7f0580a07640 1 --2- 172.21.15.121:0/4118542684 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f056003e930 0x7f0560040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:57.438 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.409+0000 7f6feda6e640 1 --2- 172.21.15.121:0/2758086991 >> v2:172.21.15.121:6808/3193900849 conn(0x7f6fcc043b00 0x7f6fcc045fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T07:33:57.438 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.409+0000 7f0571ffb640 1 -- 172.21.15.121:0/4118542684 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (crc 0 0 0) 0x7f0578013750 con 0x7f057c09db00 2024-09-16T07:33:57.438 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.410+0000 7fedabfff640 1 --2- 172.21.15.121:0/2895038226 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fed9003e980 0x7fed90040e90 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:57.439 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.410+0000 7f0580a07640 1 --2- 172.21.15.121:0/4118542684 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f056003e930 0x7f0560040e40 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:57.439 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.410+0000 7f0fecff9640 1 -- 172.21.15.121:0/2687512691 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f0fe00070b0 con 0x7f0ff009ca50 2024-09-16T07:33:57.439 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.410+0000 7f0fecff9640 1 --2- 172.21.15.121:0/2687512691 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f0fdc03e9b0 0x7f0fdc040ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:57.440 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.410+0000 7f0fecff9640 1 -- 172.21.15.121:0/2687512691 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7f0fe004f960 con 0x7f0ff009ca50 2024-09-16T07:33:57.440 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.411+0000 7f0581a09640 1 --2- 172.21.15.121:0/4118542684 >> v2:172.21.15.172:6804/2274906412 conn(0x7f0560043930 0x7f0560045e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T07:33:57.441 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.411+0000 7f0fecff9640 1 --2- 172.21.15.121:0/2687512691 >> v2:172.21.15.172:6808/3418488586 conn(0x7f0fdc0439b0 0x7f0fdc045e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:57.441 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.411+0000 7f0fecff9640 1 -- 172.21.15.121:0/2687512691 --> v2:172.21.15.172:6808/3418488586 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0fdc046510 con 0x7f0fdc0439b0 2024-09-16T07:33:57.441 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.411+0000 7f0fef7fe640 1 --2- 172.21.15.121:0/2687512691 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f0fdc03e9b0 0x7f0fdc040ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:57.441 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.411+0000 7f0fecff9640 1 -- 172.21.15.121:0/2687512691 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (crc 0 0 0) 0x7f0fe004fc70 con 0x7f0ff009ca50 2024-09-16T07:33:57.441 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.411+0000 7f0fef7fe640 1 --2- 172.21.15.121:0/2687512691 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f0fdc03e9b0 0x7f0fdc040ec0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:57.441 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.411+0000 7f0ff4cee640 1 --2- 172.21.15.121:0/2687512691 >> v2:172.21.15.172:6808/3418488586 conn(0x7f0fdc0439b0 0x7f0fdc045e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T07:33:57.442 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.413+0000 7f6feda6e640 1 --2- 172.21.15.121:0/2758086991 >> v2:172.21.15.121:6808/3193900849 conn(0x7f6fcc043b00 0x7f6fcc045fd0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:57.442 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.413+0000 7fedb1640640 1 --2- 172.21.15.121:0/2895038226 >> v2:172.21.15.121:6801/4208564222 conn(0x7fed90043980 0x7fed90045e50 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:57.442 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.415+0000 7f0ff4cee640 1 --2- 172.21.15.121:0/2687512691 >> v2:172.21.15.172:6808/3418488586 conn(0x7f0fdc0439b0 0x7f0fdc045e80 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:57.442 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.415+0000 7f6fddffb640 1 -- 172.21.15.121:0/2758086991 <== osd.0 v2:172.21.15.121:6808/3193900849 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5790 (crc 0 0 0) 0x7f6fcc046660 con 0x7f6fcc043b00 2024-09-16T07:33:57.443 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.415+0000 7feda97fa640 1 -- 172.21.15.121:0/2895038226 <== osd.1 v2:172.21.15.121:6801/4208564222 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5790 (crc 0 0 0) 0x7fed900464e0 con 0x7fed90043980 2024-09-16T07:33:57.443 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.415+0000 7f0581a09640 1 --2- 172.21.15.121:0/4118542684 >> v2:172.21.15.172:6804/2274906412 conn(0x7f0560043930 0x7f0560045e00 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:57.443 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.416+0000 7f0fecff9640 1 -- 172.21.15.121:0/2687512691 <== osd.3 v2:172.21.15.172:6808/3418488586 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5790 (crc 0 0 0) 0x7f0fdc046510 con 0x7f0fdc0439b0 2024-09-16T07:33:57.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.417+0000 7f0571ffb640 1 -- 172.21.15.121:0/4118542684 <== osd.2 v2:172.21.15.172:6804/2274906412 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5790 (crc 0 0 0) 0x7f0560046490 con 0x7f0560043930 2024-09-16T07:33:57.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.419+0000 7fedb30a3640 1 -- 172.21.15.121:0/2895038226 --> v2:172.21.15.121:6801/4208564222 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fedac1b8060 con 0x7fed90043980 2024-09-16T07:33:57.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.420+0000 7feda97fa640 1 -- 172.21.15.121:0/2895038226 <== osd.1 v2:172.21.15.121:6801/4208564222 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fedac1b8060 con 0x7fed90043980 2024-09-16T07:33:57.445 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.421+0000 7fedb30a3640 1 -- 172.21.15.121:0/2895038226 >> v2:172.21.15.121:6801/4208564222 conn(0x7fed90043980 msgr2=0x7fed90045e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:57.445 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.421+0000 7fedb30a3640 1 --2- 172.21.15.121:0/2895038226 >> v2:172.21.15.121:6801/4208564222 conn(0x7fed90043980 0x7fed90045e50 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:57.445 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.421+0000 7fedb30a3640 1 -- 172.21.15.121:0/2895038226 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fed9003e980 msgr2=0x7fed90040e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:57.445 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.421+0000 7f058346c640 1 -- 172.21.15.121:0/4118542684 --> v2:172.21.15.172:6804/2274906412 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f057c12f570 con 0x7f0560043930 2024-09-16T07:33:57.446 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.421+0000 7fedb30a3640 1 --2- 172.21.15.121:0/2895038226 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fed9003e980 0x7fed90040e90 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:57.446 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.421+0000 7fedb30a3640 1 -- 172.21.15.121:0/2895038226 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fedac068d40 msgr2=0x7fedac1b8ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:57.446 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.421+0000 7fedb30a3640 1 --2- 172.21.15.121:0/2895038226 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fedac068d40 0x7fedac1b8ed0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:57.446 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.421+0000 7fedb30a3640 1 -- 172.21.15.121:0/2895038226 shutdown_connections 2024-09-16T07:33:57.446 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.421+0000 7fedb30a3640 1 --2- 172.21.15.121:0/2895038226 >> v2:172.21.15.121:6801/4208564222 conn(0x7fed90043980 0x7fed90045e50 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:57.446 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.421+0000 7fedb30a3640 1 --2- 172.21.15.121:0/2895038226 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fed9003e980 0x7fed90040e90 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:57.446 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.421+0000 7fedb30a3640 1 --2- 172.21.15.121:0/2895038226 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fedac068d40 0x7fedac1b8ed0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:57.447 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.421+0000 7f6fef4d1640 1 -- 172.21.15.121:0/2758086991 --> v2:172.21.15.121:6808/3193900849 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6fe8098180 con 0x7f6fcc043b00 2024-09-16T07:33:57.447 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.421+0000 7fedb30a3640 1 -- 172.21.15.121:0/2895038226 >> 172.21.15.121:0/2895038226 conn(0x7fedac0a32a0 msgr2=0x7fedac09fb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:57.447 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.421+0000 7fedb30a3640 1 -- 172.21.15.121:0/2895038226 shutdown_connections 2024-09-16T07:33:57.447 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.421+0000 7fedb30a3640 1 -- 172.21.15.121:0/2895038226 wait complete. 2024-09-16T07:33:57.447 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.423+0000 7f0571ffb640 1 -- 172.21.15.121:0/4118542684 <== osd.2 v2:172.21.15.172:6804/2274906412 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f057c12f570 con 0x7f0560043930 2024-09-16T07:33:57.448 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.423+0000 7f0ff6751640 1 -- 172.21.15.121:0/2687512691 --> v2:172.21.15.172:6808/3418488586 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0ff009f9b0 con 0x7f0fdc0439b0 2024-09-16T07:33:57.448 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.423+0000 7f055f7fe640 1 -- 172.21.15.121:0/4118542684 >> v2:172.21.15.172:6804/2274906412 conn(0x7f0560043930 msgr2=0x7f0560045e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:57.448 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.423+0000 7f055f7fe640 1 --2- 172.21.15.121:0/4118542684 >> v2:172.21.15.172:6804/2274906412 conn(0x7f0560043930 0x7f0560045e00 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:57.449 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.423+0000 7f6fddffb640 1 -- 172.21.15.121:0/2758086991 <== osd.0 v2:172.21.15.121:6808/3193900849 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6fe000a820 con 0x7f6fcc043b00 2024-09-16T07:33:57.449 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.423+0000 7f055f7fe640 1 -- 172.21.15.121:0/4118542684 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f056003e930 msgr2=0x7f0560040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:57.449 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.423+0000 7f055f7fe640 1 --2- 172.21.15.121:0/4118542684 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f056003e930 0x7f0560040e40 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:57.449 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.423+0000 7f055f7fe640 1 -- 172.21.15.121:0/4118542684 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f057c09db00 msgr2=0x7f057c12d6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:57.450 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.423+0000 7f055f7fe640 1 --2- 172.21.15.121:0/4118542684 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f057c09db00 0x7f057c12d6a0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:57.450 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.424+0000 7f055f7fe640 1 -- 172.21.15.121:0/4118542684 shutdown_connections 2024-09-16T07:33:57.450 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.424+0000 7f055f7fe640 1 --2- 172.21.15.121:0/4118542684 >> v2:172.21.15.172:6804/2274906412 conn(0x7f0560043930 0x7f0560045e00 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:57.450 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.424+0000 7f055f7fe640 1 --2- 172.21.15.121:0/4118542684 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f056003e930 0x7f0560040e40 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:57.450 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.424+0000 7f055f7fe640 1 --2- 172.21.15.121:0/4118542684 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f057c09db00 0x7f057c12d6a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:57.450 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.424+0000 7f055f7fe640 1 -- 172.21.15.121:0/4118542684 >> 172.21.15.121:0/4118542684 conn(0x7f057c0a45b0 msgr2=0x7f057c0a0d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:57.450 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.424+0000 7f055f7fe640 1 -- 172.21.15.121:0/4118542684 shutdown_connections 2024-09-16T07:33:57.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.424+0000 7f055f7fe640 1 -- 172.21.15.121:0/4118542684 wait complete. 2024-09-16T07:33:57.453 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.424+0000 7f6fef4d1640 1 -- 172.21.15.121:0/2758086991 >> v2:172.21.15.121:6808/3193900849 conn(0x7f6fcc043b00 msgr2=0x7f6fcc045fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:57.453 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.424+0000 7f6fef4d1640 1 --2- 172.21.15.121:0/2758086991 >> v2:172.21.15.121:6808/3193900849 conn(0x7f6fcc043b00 0x7f6fcc045fd0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:57.454 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.424+0000 7f6fef4d1640 1 -- 172.21.15.121:0/2758086991 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f6fcc03e9d0 msgr2=0x7f6fcc040ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:57.454 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.424+0000 7f6fef4d1640 1 --2- 172.21.15.121:0/2758086991 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f6fcc03e9d0 0x7f6fcc040ee0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:57.454 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.424+0000 7f6fef4d1640 1 -- 172.21.15.121:0/2758086991 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6fe8132790 msgr2=0x7f6fe806efd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:57.454 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.424+0000 7f6fef4d1640 1 --2- 172.21.15.121:0/2758086991 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6fe8132790 0x7f6fe806efd0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:57.454 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.424+0000 7f6fef4d1640 1 -- 172.21.15.121:0/2758086991 shutdown_connections 2024-09-16T07:33:57.454 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.424+0000 7f6fef4d1640 1 --2- 172.21.15.121:0/2758086991 >> v2:172.21.15.121:6808/3193900849 conn(0x7f6fcc043b00 0x7f6fcc045fd0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:57.455 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.424+0000 7f6fef4d1640 1 --2- 172.21.15.121:0/2758086991 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f6fcc03e9d0 0x7f6fcc040ee0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:57.455 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.424+0000 7f6fef4d1640 1 --2- 172.21.15.121:0/2758086991 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6fe8132790 0x7f6fe806efd0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:57.455 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.424+0000 7f6fef4d1640 1 -- 172.21.15.121:0/2758086991 >> 172.21.15.121:0/2758086991 conn(0x7f6fe80a11f0 msgr2=0x7f6fe8130bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:57.455 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.424+0000 7f6fef4d1640 1 -- 172.21.15.121:0/2758086991 shutdown_connections 2024-09-16T07:33:57.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.425+0000 7f0fecff9640 1 -- 172.21.15.121:0/2687512691 <== osd.3 v2:172.21.15.172:6808/3418488586 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0fe800a820 con 0x7f0fdc0439b0 2024-09-16T07:33:57.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.424+0000 7f6fef4d1640 1 -- 172.21.15.121:0/2758086991 wait complete. 2024-09-16T07:33:57.459 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.425+0000 7f0ff6751640 1 -- 172.21.15.121:0/2687512691 >> v2:172.21.15.172:6808/3418488586 conn(0x7f0fdc0439b0 msgr2=0x7f0fdc045e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:57.459 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.425+0000 7f0ff6751640 1 --2- 172.21.15.121:0/2687512691 >> v2:172.21.15.172:6808/3418488586 conn(0x7f0fdc0439b0 0x7f0fdc045e80 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:57.459 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.425+0000 7f0ff6751640 1 -- 172.21.15.121:0/2687512691 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f0fdc03e9b0 msgr2=0x7f0fdc040ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:57.460 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.425+0000 7f0ff6751640 1 --2- 172.21.15.121:0/2687512691 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f0fdc03e9b0 0x7f0fdc040ec0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:57.460 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.425+0000 7f0ff6751640 1 -- 172.21.15.121:0/2687512691 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ff009ca50 msgr2=0x7f0ff0122d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:57.460 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.425+0000 7f0ff6751640 1 --2- 172.21.15.121:0/2687512691 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ff009ca50 0x7f0ff0122d60 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:57.460 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.425+0000 7f0ff6751640 1 -- 172.21.15.121:0/2687512691 shutdown_connections 2024-09-16T07:33:57.460 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.426+0000 7f0ff6751640 1 --2- 172.21.15.121:0/2687512691 >> v2:172.21.15.172:6808/3418488586 conn(0x7f0fdc0439b0 0x7f0fdc045e80 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:57.461 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.426+0000 7f0ff6751640 1 --2- 172.21.15.121:0/2687512691 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f0fdc03e9b0 0x7f0fdc040ec0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:57.461 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.426+0000 7f0ff6751640 1 --2- 172.21.15.121:0/2687512691 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ff009ca50 0x7f0ff0122d60 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:57.461 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.426+0000 7f0ff6751640 1 -- 172.21.15.121:0/2687512691 >> 172.21.15.121:0/2687512691 conn(0x7f0ff00a5230 msgr2=0x7f0ff00a74c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:57.461 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.426+0000 7f0ff6751640 1 -- 172.21.15.121:0/2687512691 shutdown_connections 2024-09-16T07:33:57.461 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.426+0000 7f0ff6751640 1 -- 172.21.15.121:0/2687512691 wait complete. 2024-09-16T07:33:57.462 INFO:teuthology.orchestra.run.smithi121.stdout:38654705671 2024-09-16T07:33:57.463 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-16T07:33:57.465 INFO:teuthology.orchestra.run.smithi121.stdout:38654705671 2024-09-16T07:33:57.465 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-16T07:33:57.466 INFO:teuthology.orchestra.run.smithi121.stdout:38654705671 2024-09-16T07:33:57.467 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-16T07:33:57.468 INFO:teuthology.orchestra.run.smithi121.stdout:38654705671 2024-09-16T07:33:57.469 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-16T07:33:57.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.619+0000 7fbc2fb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:57.624 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.619+0000 7f6c82991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:57.624 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.619+0000 7f145d991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:57.624 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.619+0000 7f5d94b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:57.624 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.625+0000 7fbc2fb91640 1 Processor -- start 2024-09-16T07:33:57.625 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.625+0000 7f145d991640 1 Processor -- start 2024-09-16T07:33:57.625 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.625+0000 7f5d94b51640 1 Processor -- start 2024-09-16T07:33:57.625 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.625+0000 7f145d991640 1 -- start start 2024-09-16T07:33:57.626 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.625+0000 7f6c82991640 1 Processor -- start 2024-09-16T07:33:57.626 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.625+0000 7f5d94b51640 1 -- start start 2024-09-16T07:33:57.626 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.625+0000 7fbc2fb91640 1 -- start start 2024-09-16T07:33:57.626 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.625+0000 7f6c82991640 1 -- start start 2024-09-16T07:33:57.627 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.626+0000 7f145d991640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f145809db00 0x7f145809df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:57.627 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.626+0000 7fbc2fb91640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fbc281360f0 0x7fbc28136500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:57.627 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.626+0000 7f145d991640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f145809ed40 con 0x7f145809e450 2024-09-16T07:33:57.627 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.626+0000 7f145d991640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f14580a0700 con 0x7f145809db00 2024-09-16T07:33:57.628 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.626+0000 7f6c82991640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f6c7c09db00 0x7f6c7c09df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:57.628 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.626+0000 7f6c82991640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c7c09ed40 con 0x7f6c7c09e450 2024-09-16T07:33:57.628 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.626+0000 7f6c82991640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f6c7c0a0700 con 0x7f6c7c09db00 2024-09-16T07:33:57.628 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.626+0000 7f5d94b51640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f5d9009d120 0x7f5d90138490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:57.628 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.626+0000 7f1456ffd640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f145809db00 0x7f145809df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:57.628 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.627+0000 7f14567fc640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f145809e450 0x7f1458138480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:57476/0 (socket says 172.21.15.121:57476) 2024-09-16T07:33:57.629 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.627+0000 7f14567fc640 1 -- 172.21.15.121:0/4175703372 learned_addr learned my addr 172.21.15.121:0/4175703372 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-16T07:33:57.629 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.626+0000 7f5d94b51640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d9009d9c0 con 0x7f5d9009c600 2024-09-16T07:33:57.629 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.626+0000 7f5d94b51640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f5d9006d7f0 con 0x7f5d9009d120 2024-09-16T07:33:57.629 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.627+0000 7f5d8e59c640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f5d9009c600 0x7f5d9009ca10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:57500/0 (socket says 172.21.15.121:57500) 2024-09-16T07:33:57.629 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.627+0000 7f5d8dd9b640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f5d9009d120 0x7f5d90138490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:57.629 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.627+0000 7f6c7bfff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f6c7c09db00 0x7f6c7c09df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:57.629 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.627+0000 7f6c7b7fe640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f6c7c09e450 0x7f6c7c138480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:57486/0 (socket says 172.21.15.121:57486) 2024-09-16T07:33:57.629 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.627+0000 7f6c7b7fe640 1 -- 172.21.15.121:0/145586933 learned_addr learned my addr 172.21.15.121:0/145586933 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-16T07:33:57.630 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.627+0000 7f6c7bfff640 1 --2- 172.21.15.121:0/145586933 >> v2:172.21.15.121:3300/0 conn(0x7f6c7c09db00 0x7f6c7c09df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55560/0 (socket says 172.21.15.121:55560) 2024-09-16T07:33:57.630 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.627+0000 7f5d8e59c640 1 -- 172.21.15.121:0/1553329307 learned_addr learned my addr 172.21.15.121:0/1553329307 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-16T07:33:57.630 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.627+0000 7fbc2d12c640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fbc2809e170 0x7fbc2809e580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:57508/0 (socket says 172.21.15.121:57508) 2024-09-16T07:33:57.630 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.627+0000 7fbc2d12c640 1 -- 172.21.15.121:0/3133371630 learned_addr learned my addr 172.21.15.121:0/3133371630 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-16T07:33:57.630 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.627+0000 7fbc2fb91640 1 -- 172.21.15.121:0/3133371630 --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc280a5c40 con 0x7fbc2809e170 2024-09-16T07:33:57.630 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.627+0000 7fbc2fb91640 1 -- 172.21.15.121:0/3133371630 --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fbc280a6010 con 0x7fbc281360f0 2024-09-16T07:33:57.631 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.627+0000 7fbc2d92d640 1 --2- 172.21.15.121:0/3133371630 >> v2:172.21.15.121:3300/0 conn(0x7fbc281360f0 0x7fbc28136500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:57.631 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.627+0000 7f6c7bfff640 1 -- 172.21.15.121:0/145586933 >> v1:172.21.15.121:6789/0 conn(0x7f6c7c09e450 legacy=0x7f6c7c138480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:57.631 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.627+0000 7f6c7bfff640 1 -- 172.21.15.121:0/145586933 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c7c09fbd0 con 0x7f6c7c09db00 2024-09-16T07:33:57.631 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.627+0000 7f1456ffd640 1 -- 172.21.15.121:0/4175703372 >> v1:172.21.15.121:6789/0 conn(0x7f145809e450 legacy=0x7f1458138480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:57.632 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.627+0000 7f1456ffd640 1 -- 172.21.15.121:0/4175703372 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f145809fbd0 con 0x7f145809db00 2024-09-16T07:33:57.632 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.627+0000 7f1455ffb640 1 -- 172.21.15.121:0/4175703372 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2481834592 0 0) 0x7f145809ed40 con 0x7f145809e450 2024-09-16T07:33:57.632 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.627+0000 7f5d8dd9b640 1 -- 172.21.15.121:0/1553329307 >> v1:172.21.15.121:6789/0 conn(0x7f5d9009c600 legacy=0x7f5d9009ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:57.632 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.627+0000 7f5d8dd9b640 1 -- 172.21.15.121:0/1553329307 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d9009d6b0 con 0x7f5d9009d120 2024-09-16T07:33:57.632 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.627+0000 7fbc2d92d640 1 -- 172.21.15.121:0/3133371630 >> v1:172.21.15.121:6789/0 conn(0x7fbc2809e170 legacy=0x7fbc2809e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:57.632 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.627+0000 7fbc2d92d640 1 -- 172.21.15.121:0/3133371630 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc2809f510 con 0x7fbc281360f0 2024-09-16T07:33:57.633 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.627+0000 7f1456ffd640 1 --2- 172.21.15.121:0/4175703372 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f145809db00 0x7f145809df10 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6504cd4d28736f1f server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:57.633 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.627+0000 7f5d8dd9b640 1 --2- 172.21.15.121:0/1553329307 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d9009d120 0x7f5d90138490 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96205a4e7392abba server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:57.633 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.627+0000 7f6c7bfff640 1 --2- 172.21.15.121:0/145586933 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6c7c09db00 0x7f6c7c09df10 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=561a53395c33da0a server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:57.633 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.628+0000 7fbc2d92d640 1 --2- 172.21.15.121:0/3133371630 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc281360f0 0x7fbc28136500 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95ebca9a7ed8057c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:57.634 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.628+0000 7f1455ffb640 1 -- 172.21.15.121:0/4175703372 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1448009d80 con 0x7f145809db00 2024-09-16T07:33:57.634 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.628+0000 7f6c7affd640 1 -- 172.21.15.121:0/145586933 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6c6c009d80 con 0x7f6c7c09db00 2024-09-16T07:33:57.634 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.628+0000 7f5d8d59a640 1 -- 172.21.15.121:0/1553329307 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5d84009d90 con 0x7f5d9009d120 2024-09-16T07:33:57.635 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.628+0000 7f1455ffb640 1 -- 172.21.15.121:0/4175703372 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f144800e230 con 0x7f145809db00 2024-09-16T07:33:57.635 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.628+0000 7f1455ffb640 1 -- 172.21.15.121:0/4175703372 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f144800e4d0 con 0x7f145809db00 2024-09-16T07:33:57.635 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.628+0000 7f6c7affd640 1 -- 172.21.15.121:0/145586933 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f6c6c00e230 con 0x7f6c7c09db00 2024-09-16T07:33:57.635 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.628+0000 7f6c7affd640 1 -- 172.21.15.121:0/145586933 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6c6c00e4d0 con 0x7f6c7c09db00 2024-09-16T07:33:57.636 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.628+0000 7f5d8d59a640 1 -- 172.21.15.121:0/1553329307 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f5d8400e230 con 0x7f5d9009d120 2024-09-16T07:33:57.636 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.628+0000 7f5d8d59a640 1 -- 172.21.15.121:0/1553329307 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5d8400e4d0 con 0x7f5d9009d120 2024-09-16T07:33:57.636 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.628+0000 7fbc2c92b640 1 -- 172.21.15.121:0/3133371630 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbc24009d90 con 0x7fbc281360f0 2024-09-16T07:33:57.636 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.628+0000 7fbc2c92b640 1 -- 172.21.15.121:0/3133371630 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fbc2400e230 con 0x7fbc281360f0 2024-09-16T07:33:57.636 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.628+0000 7fbc2c92b640 1 -- 172.21.15.121:0/3133371630 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbc2400e4d0 con 0x7fbc281360f0 2024-09-16T07:33:57.637 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.629+0000 7f145d991640 1 -- 172.21.15.121:0/4175703372 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f145809db00 msgr2=0x7f145809df10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:57.637 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.629+0000 7f145d991640 1 --2- 172.21.15.121:0/4175703372 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f145809db00 0x7f145809df10 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:57.637 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.629+0000 7f145d991640 1 -- 172.21.15.121:0/4175703372 shutdown_connections 2024-09-16T07:33:57.637 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.629+0000 7f145d991640 1 --2- 172.21.15.121:0/4175703372 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f145809db00 0x7f145809df10 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:57.637 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.629+0000 7f145d991640 1 -- 172.21.15.121:0/4175703372 >> 172.21.15.121:0/4175703372 conn(0x7f14580a45b0 msgr2=0x7f14580a49c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:57.637 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.629+0000 7f145d991640 1 -- 172.21.15.121:0/4175703372 shutdown_connections 2024-09-16T07:33:57.638 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.629+0000 7fbc2fb91640 1 -- 172.21.15.121:0/3133371630 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc281360f0 msgr2=0x7fbc28136500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:57.638 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.629+0000 7fbc2fb91640 1 --2- 172.21.15.121:0/3133371630 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc281360f0 0x7fbc28136500 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:57.638 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.629+0000 7f145d991640 1 -- 172.21.15.121:0/4175703372 wait complete. 2024-09-16T07:33:57.639 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.629+0000 7fbc2fb91640 1 -- 172.21.15.121:0/3133371630 shutdown_connections 2024-09-16T07:33:57.639 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.629+0000 7fbc2fb91640 1 --2- 172.21.15.121:0/3133371630 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc281360f0 0x7fbc28136500 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:57.639 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.629+0000 7fbc2fb91640 1 -- 172.21.15.121:0/3133371630 >> 172.21.15.121:0/3133371630 conn(0x7fbc2806f850 msgr2=0x7fbc2809ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:57.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.629+0000 7f5d94b51640 1 -- 172.21.15.121:0/1553329307 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d9009d120 msgr2=0x7f5d90138490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:57.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.629+0000 7f5d94b51640 1 --2- 172.21.15.121:0/1553329307 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d9009d120 0x7f5d90138490 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:57.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.629+0000 7f6c82991640 1 -- 172.21.15.121:0/145586933 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6c7c09db00 msgr2=0x7f6c7c09df10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:57.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.629+0000 7f6c82991640 1 --2- 172.21.15.121:0/145586933 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6c7c09db00 0x7f6c7c09df10 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:57.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.629+0000 7f145d991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:57.641 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.629+0000 7f5d94b51640 1 -- 172.21.15.121:0/1553329307 shutdown_connections 2024-09-16T07:33:57.641 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.629+0000 7f5d94b51640 1 --2- 172.21.15.121:0/1553329307 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d9009d120 0x7f5d90138490 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:57.641 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.629+0000 7f5d94b51640 1 -- 172.21.15.121:0/1553329307 >> 172.21.15.121:0/1553329307 conn(0x7f5d900a3000 msgr2=0x7f5d900a3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:57.641 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.629+0000 7f6c82991640 1 -- 172.21.15.121:0/145586933 shutdown_connections 2024-09-16T07:33:57.641 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.629+0000 7f6c82991640 1 --2- 172.21.15.121:0/145586933 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6c7c09db00 0x7f6c7c09df10 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:57.642 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.629+0000 7f6c82991640 1 -- 172.21.15.121:0/145586933 >> 172.21.15.121:0/145586933 conn(0x7f6c7c0a45b0 msgr2=0x7f6c7c0a49c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:57.642 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.630+0000 7fbc2fb91640 1 -- 172.21.15.121:0/3133371630 shutdown_connections 2024-09-16T07:33:57.642 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.630+0000 7f6c82991640 1 -- 172.21.15.121:0/145586933 shutdown_connections 2024-09-16T07:33:57.642 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.630+0000 7f5d94b51640 1 -- 172.21.15.121:0/1553329307 shutdown_connections 2024-09-16T07:33:57.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.630+0000 7fbc2fb91640 1 -- 172.21.15.121:0/3133371630 wait complete. 2024-09-16T07:33:57.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.630+0000 7f6c82991640 1 -- 172.21.15.121:0/145586933 wait complete. 2024-09-16T07:33:57.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.630+0000 7f5d94b51640 1 -- 172.21.15.121:0/1553329307 wait complete. 2024-09-16T07:33:57.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.630+0000 7f6c82991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:57.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.630+0000 7fbc2fb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:57.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.630+0000 7f5d94b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:57.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.631+0000 7f145d991640 1 Processor -- start 2024-09-16T07:33:57.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.631+0000 7f145d991640 1 -- start start 2024-09-16T07:33:57.645 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.631+0000 7f6c82991640 1 Processor -- start 2024-09-16T07:33:57.645 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.631+0000 7f6c82991640 1 -- start start 2024-09-16T07:33:57.645 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.631+0000 7f5d94b51640 1 Processor -- start 2024-09-16T07:33:57.645 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.631+0000 7fbc2fb91640 1 Processor -- start 2024-09-16T07:33:57.646 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.631+0000 7f5d94b51640 1 -- start start 2024-09-16T07:33:57.646 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.632+0000 7fbc2fb91640 1 -- start start 2024-09-16T07:33:57.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.632+0000 7f145d991640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f145809db00 0x7f145806e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:57.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.632+0000 7f145d991640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1458099410 con 0x7f145809db00 2024-09-16T07:33:57.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.632+0000 7f1456ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f145809db00 0x7f145806e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:57.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.632+0000 7f1456ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f145809db00 0x7f145806e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55608/0 (socket says 172.21.15.121:55608) 2024-09-16T07:33:57.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.632+0000 7f1456ffd640 1 -- 172.21.15.121:0/3749730028 learned_addr learned my addr 172.21.15.121:0/3749730028 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:33:57.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.632+0000 7f6c82991640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6c7c09db00 0x7f6c7c1b5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:57.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.632+0000 7f6c82991640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6c7c1b6050 con 0x7f6c7c09db00 2024-09-16T07:33:57.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.633+0000 7f5d94b51640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d9009c600 0x7f5d90092890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:57.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.633+0000 7f5d94b51640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5d90096770 con 0x7f5d9009c600 2024-09-16T07:33:57.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.633+0000 7f6c7bfff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6c7c09db00 0x7f6c7c1b5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:57.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.633+0000 7f6c7bfff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6c7c09db00 0x7f6c7c1b5830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55616/0 (socket says 172.21.15.121:55616) 2024-09-16T07:33:57.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.633+0000 7f6c7bfff640 1 -- 172.21.15.121:0/1848550699 learned_addr learned my addr 172.21.15.121:0/1848550699 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:33:57.649 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.633+0000 7fbc2fb91640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc2809e170 0x7fbc281250c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:57.649 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.633+0000 7fbc2fb91640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbc281272d0 con 0x7fbc2809e170 2024-09-16T07:33:57.649 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.633+0000 7f5d8e59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d9009c600 0x7f5d90092890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:57.649 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.633+0000 7f1456ffd640 1 -- 172.21.15.121:0/3749730028 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14580746a0 con 0x7f145809db00 2024-09-16T07:33:57.650 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.633+0000 7fbc2d92d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc2809e170 0x7fbc281250c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:57.650 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.633+0000 7f5d8e59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d9009c600 0x7f5d90092890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55618/0 (socket says 172.21.15.121:55618) 2024-09-16T07:33:57.650 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.633+0000 7f5d8e59c640 1 -- 172.21.15.121:0/2055336734 learned_addr learned my addr 172.21.15.121:0/2055336734 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:33:57.650 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.633+0000 7fbc2d92d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc2809e170 0x7fbc281250c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55630/0 (socket says 172.21.15.121:55630) 2024-09-16T07:33:57.651 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.633+0000 7fbc2d92d640 1 -- 172.21.15.121:0/1618535211 learned_addr learned my addr 172.21.15.121:0/1618535211 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:33:57.651 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.633+0000 7f6c7bfff640 1 -- 172.21.15.121:0/1848550699 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c7c1b9f70 con 0x7f6c7c09db00 2024-09-16T07:33:57.651 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.633+0000 7f6c7bfff640 1 --2- 172.21.15.121:0/1848550699 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6c7c09db00 0x7f6c7c1b5830 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:57.651 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.633+0000 7f5d8e59c640 1 -- 172.21.15.121:0/2055336734 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d90095c30 con 0x7f5d9009c600 2024-09-16T07:33:57.652 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.633+0000 7f1456ffd640 1 --2- 172.21.15.121:0/3749730028 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f145809db00 0x7f145806e8d0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:57.652 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.633+0000 7f6c78ff9640 1 -- 172.21.15.121:0/1848550699 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6c6c014620 con 0x7f6c7c09db00 2024-09-16T07:33:57.652 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.633+0000 7fbc2d92d640 1 -- 172.21.15.121:0/1618535211 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc28126a10 con 0x7fbc2809e170 2024-09-16T07:33:57.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.633+0000 7f6c82991640 1 -- 172.21.15.121:0/1848550699 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c7c1b43f0 con 0x7f6c7c09db00 2024-09-16T07:33:57.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.633+0000 7f6c78ff9640 1 -- 172.21.15.121:0/1848550699 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f6c6c014780 con 0x7f6c7c09db00 2024-09-16T07:33:57.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.633+0000 7f143ffff640 1 -- 172.21.15.121:0/3749730028 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1448014620 con 0x7f145809db00 2024-09-16T07:33:57.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.634+0000 7f143ffff640 1 -- 172.21.15.121:0/3749730028 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1448014780 con 0x7f145809db00 2024-09-16T07:33:57.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.634+0000 7f6c82991640 1 -- 172.21.15.121:0/1848550699 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c7c1b3b20 con 0x7f6c7c09db00 2024-09-16T07:33:57.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.634+0000 7f6c78ff9640 1 -- 172.21.15.121:0/1848550699 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6c6c014620 con 0x7f6c7c09db00 2024-09-16T07:33:57.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.633+0000 7f5d8e59c640 1 --2- 172.21.15.121:0/2055336734 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d9009c600 0x7f5d90092890 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:57.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.634+0000 7f143ffff640 1 -- 172.21.15.121:0/3749730028 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1448014a20 con 0x7f145809db00 2024-09-16T07:33:57.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.634+0000 7f145d991640 1 -- 172.21.15.121:0/3749730028 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14580701e0 con 0x7f145809db00 2024-09-16T07:33:57.655 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.634+0000 7fbc2d92d640 1 --2- 172.21.15.121:0/1618535211 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc2809e170 0x7fbc281250c0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:57.655 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.634+0000 7f145d991640 1 -- 172.21.15.121:0/3749730028 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1458098f30 con 0x7f145809db00 2024-09-16T07:33:57.655 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.634+0000 7f5d7effd640 1 -- 172.21.15.121:0/2055336734 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5d80005a60 con 0x7f5d9009c600 2024-09-16T07:33:57.655 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.634+0000 7f5d7effd640 1 -- 172.21.15.121:0/2055336734 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f5d80005bc0 con 0x7f5d9009c600 2024-09-16T07:33:57.656 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.634+0000 7f5d7effd640 1 -- 172.21.15.121:0/2055336734 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5d80005e60 con 0x7f5d9009c600 2024-09-16T07:33:57.656 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.634+0000 7f5d94b51640 1 -- 172.21.15.121:0/2055336734 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d900a0220 con 0x7f5d9009c600 2024-09-16T07:33:57.656 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.634+0000 7f5d94b51640 1 -- 172.21.15.121:0/2055336734 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d900958d0 con 0x7f5d9009c600 2024-09-16T07:33:57.656 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.635+0000 7fbc1e7fc640 1 -- 172.21.15.121:0/1618535211 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbc24014620 con 0x7fbc2809e170 2024-09-16T07:33:57.656 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.635+0000 7fbc1e7fc640 1 -- 172.21.15.121:0/1618535211 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fbc24014780 con 0x7fbc2809e170 2024-09-16T07:33:57.656 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.635+0000 7fbc2fb91640 1 -- 172.21.15.121:0/1618535211 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc28128380 con 0x7fbc2809e170 2024-09-16T07:33:57.657 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.635+0000 7f5d94b51640 1 -- 172.21.15.121:0/2055336734 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d9009ca10 con 0x7f5d9009c600 2024-09-16T07:33:57.657 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.635+0000 7f6c78ff9640 1 -- 172.21.15.121:0/1848550699 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f6c6c014990 con 0x7f6c7c09db00 2024-09-16T07:33:57.657 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.635+0000 7f6c82991640 1 -- 172.21.15.121:0/1848550699 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c7c09df10 con 0x7f6c7c09db00 2024-09-16T07:33:57.657 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.635+0000 7f6c78ff9640 1 --2- 172.21.15.121:0/1848550699 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f6c6803e990 0x7f6c68040ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:57.657 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.636+0000 7f143ffff640 1 -- 172.21.15.121:0/3749730028 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f1448014c20 con 0x7f145809db00 2024-09-16T07:33:57.658 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.636+0000 7f6c78ff9640 1 -- 172.21.15.121:0/1848550699 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7f6c6c019040 con 0x7f6c7c09db00 2024-09-16T07:33:57.658 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.636+0000 7f143ffff640 1 --2- 172.21.15.121:0/3749730028 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f144403e910 0x7f1444040e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:57.658 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.636+0000 7fbc1e7fc640 1 -- 172.21.15.121:0/1618535211 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbc24014a20 con 0x7fbc2809e170 2024-09-16T07:33:57.658 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.636+0000 7fbc2fb91640 1 -- 172.21.15.121:0/1618535211 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc28128b20 con 0x7fbc2809e170 2024-09-16T07:33:57.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.636+0000 7f6c7b7fe640 1 --2- 172.21.15.121:0/1848550699 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f6c6803e990 0x7f6c68040ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:57.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.636+0000 7f143ffff640 1 -- 172.21.15.121:0/3749730028 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7f1448019040 con 0x7f145809db00 2024-09-16T07:33:57.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.636+0000 7f5d7effd640 1 -- 172.21.15.121:0/2055336734 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f5d800070b0 con 0x7f5d9009c600 2024-09-16T07:33:57.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.636+0000 7f5d7effd640 1 --2- 172.21.15.121:0/2055336734 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f5d70042de0 0x7f5d700452f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:57.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.636+0000 7f5d7effd640 1 -- 172.21.15.121:0/2055336734 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7f5d8004f620 con 0x7f5d9009c600 2024-09-16T07:33:57.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.636+0000 7f14567fc640 1 --2- 172.21.15.121:0/3749730028 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f144403e910 0x7f1444040e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:57.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.636+0000 7f5d8dd9b640 1 --2- 172.21.15.121:0/2055336734 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f5d70042de0 0x7f5d700452f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:57.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.637+0000 7fbc1e7fc640 1 -- 172.21.15.121:0/1618535211 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fbc24014b80 con 0x7fbc2809e170 2024-09-16T07:33:57.661 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.637+0000 7f145d991640 1 -- 172.21.15.121:0/3749730028 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14580746a0 con 0x7f145809db00 2024-09-16T07:33:57.661 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.637+0000 7f6c7b7fe640 1 --2- 172.21.15.121:0/1848550699 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f6c6803e990 0x7f6c68040ea0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:57.661 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.637+0000 7f5d8dd9b640 1 --2- 172.21.15.121:0/2055336734 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f5d70042de0 0x7f5d700452f0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:57.661 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.637+0000 7fbc1e7fc640 1 --2- 172.21.15.121:0/1618535211 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fbc0c03e9b0 0x7fbc0c040ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:57.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.637+0000 7f14567fc640 1 --2- 172.21.15.121:0/3749730028 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f144403e910 0x7f1444040e20 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:57.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.637+0000 7fbc2d12c640 1 --2- 172.21.15.121:0/1618535211 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fbc0c03e9b0 0x7fbc0c040ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:57.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.637+0000 7fbc2fb91640 1 -- 172.21.15.121:0/1618535211 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc28128de0 con 0x7fbc2809e170 2024-09-16T07:33:57.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.638+0000 7fbc2d12c640 1 --2- 172.21.15.121:0/1618535211 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fbc0c03e9b0 0x7fbc0c040ec0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:57.663 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.642+0000 7f5d7effd640 1 -- 172.21.15.121:0/2055336734 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f5d8000dc60 con 0x7f5d9009c600 2024-09-16T07:33:57.663 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.647+0000 7fbc1e7fc640 1 -- 172.21.15.121:0/1618535211 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7fbc2400d740 con 0x7fbc2809e170 2024-09-16T07:33:57.663 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.647+0000 7f6c78ff9640 1 -- 172.21.15.121:0/1848550699 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f6c6c011520 con 0x7f6c7c09db00 2024-09-16T07:33:57.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.652+0000 7f143ffff640 1 -- 172.21.15.121:0/3749730028 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f1448011520 con 0x7f145809db00 2024-09-16T07:33:57.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.657+0000 7fbc1e7fc640 1 -- 172.21.15.121:0/1618535211 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fbc24011570 con 0x7fbc2809e170 2024-09-16T07:33:57.826 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.827+0000 7f5d94b51640 1 -- 172.21.15.121:0/2055336734 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f5d90050fc0 con 0x7f5d9009c600 2024-09-16T07:33:57.827 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.827+0000 7f5d7effd640 1 -- 172.21.15.121:0/2055336734 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (crc 0 0 0) 0x7f5d8000d660 con 0x7f5d9009c600 2024-09-16T07:33:57.827 INFO:teuthology.orchestra.run.smithi121.stdout:38654705671 2024-09-16T07:33:57.829 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.829+0000 7f5d94b51640 1 -- 172.21.15.121:0/2055336734 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f5d70042de0 msgr2=0x7f5d700452f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:57.829 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.829+0000 7f5d94b51640 1 --2- 172.21.15.121:0/2055336734 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f5d70042de0 0x7f5d700452f0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:57.829 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.829+0000 7f5d94b51640 1 -- 172.21.15.121:0/2055336734 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d9009c600 msgr2=0x7f5d90092890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:57.829 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.829+0000 7f5d94b51640 1 --2- 172.21.15.121:0/2055336734 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d9009c600 0x7f5d90092890 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:57.829 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.829+0000 7f5d94b51640 1 -- 172.21.15.121:0/2055336734 shutdown_connections 2024-09-16T07:33:57.829 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.829+0000 7f5d94b51640 1 --2- 172.21.15.121:0/2055336734 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f5d70042de0 0x7f5d700452f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:57.829 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.829+0000 7f5d94b51640 1 --2- 172.21.15.121:0/2055336734 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d9009c600 0x7f5d90092890 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:57.830 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.829+0000 7f5d94b51640 1 -- 172.21.15.121:0/2055336734 >> 172.21.15.121:0/2055336734 conn(0x7f5d900a3000 msgr2=0x7f5d900722f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:57.830 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.830+0000 7f5d94b51640 1 -- 172.21.15.121:0/2055336734 shutdown_connections 2024-09-16T07:33:57.830 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.830+0000 7f5d94b51640 1 -- 172.21.15.121:0/2055336734 wait complete. 2024-09-16T07:33:57.840 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705671 for osd.0 2024-09-16T07:33:57.841 DEBUG:teuthology.parallel:result is None 2024-09-16T07:33:57.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.842+0000 7fbc2fb91640 1 -- 172.21.15.121:0/1618535211 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fbc28129000 con 0x7fbc2809e170 2024-09-16T07:33:57.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.842+0000 7fbc1e7fc640 1 -- 172.21.15.121:0/1618535211 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (crc 0 0 0) 0x7fbc2400d1c0 con 0x7fbc2809e170 2024-09-16T07:33:57.842 INFO:teuthology.orchestra.run.smithi121.stdout:38654705671 2024-09-16T07:33:57.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.844+0000 7fbc2fb91640 1 -- 172.21.15.121:0/1618535211 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fbc0c03e9b0 msgr2=0x7fbc0c040ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:57.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.844+0000 7fbc2fb91640 1 --2- 172.21.15.121:0/1618535211 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fbc0c03e9b0 0x7fbc0c040ec0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:57.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.844+0000 7fbc2fb91640 1 -- 172.21.15.121:0/1618535211 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc2809e170 msgr2=0x7fbc281250c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:57.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.844+0000 7fbc2fb91640 1 --2- 172.21.15.121:0/1618535211 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc2809e170 0x7fbc281250c0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:57.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.844+0000 7fbc2fb91640 1 -- 172.21.15.121:0/1618535211 shutdown_connections 2024-09-16T07:33:57.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.844+0000 7fbc2fb91640 1 --2- 172.21.15.121:0/1618535211 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fbc0c03e9b0 0x7fbc0c040ec0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:57.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.844+0000 7fbc2fb91640 1 --2- 172.21.15.121:0/1618535211 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc2809e170 0x7fbc281250c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:57.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.844+0000 7fbc2fb91640 1 -- 172.21.15.121:0/1618535211 >> 172.21.15.121:0/1618535211 conn(0x7fbc2806f850 msgr2=0x7fbc280a3d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:57.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.844+0000 7fbc2fb91640 1 -- 172.21.15.121:0/1618535211 shutdown_connections 2024-09-16T07:33:57.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.844+0000 7fbc2fb91640 1 -- 172.21.15.121:0/1618535211 wait complete. 2024-09-16T07:33:57.855 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705671 for osd.3 2024-09-16T07:33:57.855 DEBUG:teuthology.parallel:result is None 2024-09-16T07:33:57.866 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.867+0000 7f6c82991640 1 -- 172.21.15.121:0/1848550699 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f6c7c1b9d70 con 0x7f6c7c09db00 2024-09-16T07:33:57.866 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.867+0000 7f6c78ff9640 1 -- 172.21.15.121:0/1848550699 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (crc 0 0 0) 0x7f6c6c0116c0 con 0x7f6c7c09db00 2024-09-16T07:33:57.867 INFO:teuthology.orchestra.run.smithi121.stdout:38654705671 2024-09-16T07:33:57.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.870+0000 7f6c82991640 1 -- 172.21.15.121:0/1848550699 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f6c6803e990 msgr2=0x7f6c68040ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:57.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.870+0000 7f6c82991640 1 --2- 172.21.15.121:0/1848550699 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f6c6803e990 0x7f6c68040ea0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:57.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.870+0000 7f6c82991640 1 -- 172.21.15.121:0/1848550699 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6c7c09db00 msgr2=0x7f6c7c1b5830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:57.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.870+0000 7f6c82991640 1 --2- 172.21.15.121:0/1848550699 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6c7c09db00 0x7f6c7c1b5830 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:57.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.870+0000 7f6c82991640 1 -- 172.21.15.121:0/1848550699 shutdown_connections 2024-09-16T07:33:57.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.870+0000 7f6c82991640 1 --2- 172.21.15.121:0/1848550699 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f6c6803e990 0x7f6c68040ea0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:57.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.870+0000 7f6c82991640 1 --2- 172.21.15.121:0/1848550699 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6c7c09db00 0x7f6c7c1b5830 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:57.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.870+0000 7f6c82991640 1 -- 172.21.15.121:0/1848550699 >> 172.21.15.121:0/1848550699 conn(0x7f6c7c0a45b0 msgr2=0x7f6c7c0a0d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:57.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.870+0000 7f6c82991640 1 -- 172.21.15.121:0/1848550699 shutdown_connections 2024-09-16T07:33:57.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.870+0000 7f6c82991640 1 -- 172.21.15.121:0/1848550699 wait complete. 2024-09-16T07:33:57.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.874+0000 7f145d991640 1 -- 172.21.15.121:0/3749730028 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f14580746a0 con 0x7f145809db00 2024-09-16T07:33:57.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.874+0000 7f143ffff640 1 -- 172.21.15.121:0/3749730028 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (crc 0 0 0) 0x7f1448011520 con 0x7f145809db00 2024-09-16T07:33:57.873 INFO:teuthology.orchestra.run.smithi121.stdout:38654705671 2024-09-16T07:33:57.877 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.878+0000 7f145d991640 1 -- 172.21.15.121:0/3749730028 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f144403e910 msgr2=0x7f1444040e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:57.877 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.878+0000 7f145d991640 1 --2- 172.21.15.121:0/3749730028 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f144403e910 0x7f1444040e20 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:57.877 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.878+0000 7f145d991640 1 -- 172.21.15.121:0/3749730028 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f145809db00 msgr2=0x7f145806e8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:57.878 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.878+0000 7f145d991640 1 --2- 172.21.15.121:0/3749730028 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f145809db00 0x7f145806e8d0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:57.878 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.878+0000 7f145d991640 1 -- 172.21.15.121:0/3749730028 shutdown_connections 2024-09-16T07:33:57.878 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.878+0000 7f145d991640 1 --2- 172.21.15.121:0/3749730028 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f144403e910 0x7f1444040e20 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:57.878 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.878+0000 7f145d991640 1 --2- 172.21.15.121:0/3749730028 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f145809db00 0x7f145806e8d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:57.878 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.878+0000 7f145d991640 1 -- 172.21.15.121:0/3749730028 >> 172.21.15.121:0/3749730028 conn(0x7f14580a45b0 msgr2=0x7f14580a0d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:57.878 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.878+0000 7f145d991640 1 -- 172.21.15.121:0/3749730028 shutdown_connections 2024-09-16T07:33:57.878 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:57.878+0000 7f145d991640 1 -- 172.21.15.121:0/3749730028 wait complete. 2024-09-16T07:33:57.883 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705671 for osd.1 2024-09-16T07:33:57.883 DEBUG:teuthology.parallel:result is None 2024-09-16T07:33:57.889 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705671 for osd.2 2024-09-16T07:33:57.889 DEBUG:teuthology.parallel:result is None 2024-09-16T07:33:57.889 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-16T07:33:57.889 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:33:58.038 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.035+0000 7f1e5e751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:58.039 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.040+0000 7f1e5e751640 1 Processor -- start 2024-09-16T07:33:58.039 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.040+0000 7f1e5e751640 1 -- start start 2024-09-16T07:33:58.041 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.041+0000 7f1e5e751640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f1e580a0590 0x7f1e581390a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:58.041 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.041+0000 7f1e5e751640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e58071b20 con 0x7f1e5809fa70 2024-09-16T07:33:58.041 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.041+0000 7f1e5e751640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f1e580a0b30 con 0x7f1e580a0590 2024-09-16T07:33:58.041 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.041+0000 7f1e577fe640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f1e580a0590 0x7f1e581390a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:58.041 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.041+0000 7f1e577fe640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f1e580a0590 0x7f1e581390a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55640/0 (socket says 172.21.15.121:55640) 2024-09-16T07:33:58.041 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.042+0000 7f1e577fe640 1 -- 172.21.15.121:0/1773047607 learned_addr learned my addr 172.21.15.121:0/1773047607 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:33:58.041 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.041+0000 7f1e57fff640 1 --1- 172.21.15.121:0/1773047607 >> v1:172.21.15.121:6789/0 conn(0x7f1e5809fa70 0x7f1e5809fe80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:57524/0 (socket says 172.21.15.121:57524) 2024-09-16T07:33:58.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.042+0000 7f1e577fe640 1 -- 172.21.15.121:0/1773047607 >> v1:172.21.15.121:6789/0 conn(0x7f1e5809fa70 legacy=0x7f1e5809fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:58.043 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.042+0000 7f1e577fe640 1 -- 172.21.15.121:0/1773047607 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e580a1a60 con 0x7f1e580a0590 2024-09-16T07:33:58.043 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.042+0000 7f1e56ffd640 1 -- 172.21.15.121:0/1773047607 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 374915563 0 0) 0x7f1e58071b20 con 0x7f1e5809fa70 2024-09-16T07:33:58.043 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.042+0000 7f1e577fe640 1 --2- 172.21.15.121:0/1773047607 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1e580a0590 0x7f1e581390a0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1fd84b6ae348404 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:58.043 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.042+0000 7f1e56ffd640 1 -- 172.21.15.121:0/1773047607 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1e4c009e50 con 0x7f1e580a0590 2024-09-16T07:33:58.043 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.042+0000 7f1e56ffd640 1 -- 172.21.15.121:0/1773047607 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1e4c00e230 con 0x7f1e580a0590 2024-09-16T07:33:58.043 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.042+0000 7f1e56ffd640 1 -- 172.21.15.121:0/1773047607 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1e4c00e4d0 con 0x7f1e580a0590 2024-09-16T07:33:58.043 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.043+0000 7f1e5e751640 1 -- 172.21.15.121:0/1773047607 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1e580a0590 msgr2=0x7f1e581390a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:58.043 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.043+0000 7f1e5e751640 1 --2- 172.21.15.121:0/1773047607 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1e580a0590 0x7f1e581390a0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:58.043 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.043+0000 7f1e5e751640 1 -- 172.21.15.121:0/1773047607 shutdown_connections 2024-09-16T07:33:58.043 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.043+0000 7f1e5e751640 1 --2- 172.21.15.121:0/1773047607 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1e580a0590 0x7f1e581390a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:58.043 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.043+0000 7f1e5e751640 1 -- 172.21.15.121:0/1773047607 >> 172.21.15.121:0/1773047607 conn(0x7f1e580a33b0 msgr2=0x7f1e580a37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:58.043 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.043+0000 7f1e5e751640 1 -- 172.21.15.121:0/1773047607 shutdown_connections 2024-09-16T07:33:58.043 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.043+0000 7f1e5e751640 1 -- 172.21.15.121:0/1773047607 wait complete. 2024-09-16T07:33:58.044 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.043+0000 7f1e5e751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:58.044 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.045+0000 7f1e5e751640 1 Processor -- start 2024-09-16T07:33:58.044 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.045+0000 7f1e5e751640 1 -- start start 2024-09-16T07:33:58.046 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.046+0000 7f1e5e751640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1e5809fa70 0x7f1e5811fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:58.046 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.046+0000 7f1e5e751640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1e58133d60 con 0x7f1e5809fa70 2024-09-16T07:33:58.046 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.046+0000 7f1e57fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1e5809fa70 0x7f1e5811fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:58.046 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.046+0000 7f1e57fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1e5809fa70 0x7f1e5811fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55650/0 (socket says 172.21.15.121:55650) 2024-09-16T07:33:58.046 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.046+0000 7f1e57fff640 1 -- 172.21.15.121:0/1762516543 learned_addr learned my addr 172.21.15.121:0/1762516543 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:33:58.046 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.046+0000 7f1e57fff640 1 -- 172.21.15.121:0/1762516543 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e58123b30 con 0x7f1e5809fa70 2024-09-16T07:33:58.046 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.046+0000 7f1e57fff640 1 --2- 172.21.15.121:0/1762516543 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1e5809fa70 0x7f1e5811fbc0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:58.046 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.046+0000 7f1e54ff9640 1 -- 172.21.15.121:0/1762516543 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1e48004b80 con 0x7f1e5809fa70 2024-09-16T07:33:58.046 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.046+0000 7f1e54ff9640 1 -- 172.21.15.121:0/1762516543 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1e48004ce0 con 0x7f1e5809fa70 2024-09-16T07:33:58.046 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.046+0000 7f1e5e751640 1 -- 172.21.15.121:0/1762516543 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e58121dd0 con 0x7f1e5809fa70 2024-09-16T07:33:58.046 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.046+0000 7f1e54ff9640 1 -- 172.21.15.121:0/1762516543 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1e48007120 con 0x7f1e5809fa70 2024-09-16T07:33:58.047 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.047+0000 7f1e5e751640 1 -- 172.21.15.121:0/1762516543 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e58120f70 con 0x7f1e5809fa70 2024-09-16T07:33:58.047 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.047+0000 7f1e54ff9640 1 -- 172.21.15.121:0/1762516543 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f1e480072d0 con 0x7f1e5809fa70 2024-09-16T07:33:58.047 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.047+0000 7f1e5e751640 1 -- 172.21.15.121:0/1762516543 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e5809fe80 con 0x7f1e5809fa70 2024-09-16T07:33:58.047 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.048+0000 7f1e54ff9640 1 --2- 172.21.15.121:0/1762516543 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f1e4403e930 0x7f1e44040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:58.047 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.048+0000 7f1e54ff9640 1 -- 172.21.15.121:0/1762516543 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7f1e4804f8e0 con 0x7f1e5809fa70 2024-09-16T07:33:58.048 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.048+0000 7f1e577fe640 1 --2- 172.21.15.121:0/1762516543 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f1e4403e930 0x7f1e44040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:58.048 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.049+0000 7f1e577fe640 1 --2- 172.21.15.121:0/1762516543 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f1e4403e930 0x7f1e44040e40 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:58.052 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.053+0000 7f1e54ff9640 1 -- 172.21.15.121:0/1762516543 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f1e4800f230 con 0x7f1e5809fa70 2024-09-16T07:33:58.226 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.227+0000 7f1e5e751640 1 -- 172.21.15.121:0/1762516543 --> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1e58071730 con 0x7f1e4403e930 2024-09-16T07:33:58.228 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.229+0000 7f1e54ff9640 1 -- 172.21.15.121:0/1762516543 <== mgr.4102 v2:172.21.15.172:6800/643901738 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31130 (crc 0 0 0) 0x7f1e4c009da0 con 0x7f1e4403e930 2024-09-16T07:33:58.229 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:33:58.229 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-09-16T07:33:58.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.231+0000 7f1e5e751640 1 -- 172.21.15.121:0/1762516543 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f1e4403e930 msgr2=0x7f1e44040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:58.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.231+0000 7f1e5e751640 1 --2- 172.21.15.121:0/1762516543 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f1e4403e930 0x7f1e44040e40 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:58.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.231+0000 7f1e5e751640 1 -- 172.21.15.121:0/1762516543 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1e5809fa70 msgr2=0x7f1e5811fbc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:58.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.231+0000 7f1e5e751640 1 --2- 172.21.15.121:0/1762516543 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1e5809fa70 0x7f1e5811fbc0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:58.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.231+0000 7f1e5e751640 1 -- 172.21.15.121:0/1762516543 shutdown_connections 2024-09-16T07:33:58.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.231+0000 7f1e5e751640 1 --2- 172.21.15.121:0/1762516543 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f1e4403e930 0x7f1e44040e40 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:58.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.231+0000 7f1e5e751640 1 --2- 172.21.15.121:0/1762516543 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1e5809fa70 0x7f1e5811fbc0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:58.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.231+0000 7f1e5e751640 1 -- 172.21.15.121:0/1762516543 >> 172.21.15.121:0/1762516543 conn(0x7f1e580a33b0 msgr2=0x7f1e5809ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:58.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.231+0000 7f1e5e751640 1 -- 172.21.15.121:0/1762516543 shutdown_connections 2024-09-16T07:33:58.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.231+0000 7f1e5e751640 1 -- 172.21.15.121:0/1762516543 wait complete. 2024-09-16T07:33:58.242 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2024-09-16T07:33:57.428038+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":107984,"kb_used_data":624,"kb_used_omap":0,"kb_used_meta":107264,"kb_avail":377379376,"statfs":{"total":386547056640,"available":386436481024,"internally_reserved":0,"allocated":638976,"data_stored":1315786,"data_compressed":60088,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":109838336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T07:33:55.958430+0000","last_change":"2024-09-16T07:33:55.962652+0000","last_active":"2024-09-16T07:33:55.958430+0000","last_peered":"2024-09-16T07:33:55.958430+0000","last_clean":"2024-09-16T07:33:55.958430+0000","last_became_active":"2024-09-16T07:33:53.988604+0000","last_became_peered":"2024-09-16T07:33:53.988604+0000","last_unstale":"2024-09-16T07:33:55.958430+0000","last_undegraded":"2024-09-16T07:33:55.958430+0000","last_fullsized":"2024-09-16T07:33:55.958430+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_clean_scrub_stamp":"2024-09-16T07:33:52.925999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T07:33:55.961692+0000","last_change":"2024-09-16T07:33:55.963562+0000","last_active":"2024-09-16T07:33:55.961692+0000","last_peered":"2024-09-16T07:33:55.961692+0000","last_clean":"2024-09-16T07:33:55.961692+0000","last_became_active":"2024-09-16T07:33:53.999244+0000","last_became_peered":"2024-09-16T07:33:53.999244+0000","last_unstale":"2024-09-16T07:33:55.961692+0000","last_undegraded":"2024-09-16T07:33:55.961692+0000","last_fullsized":"2024-09-16T07:33:55.961692+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_clean_scrub_stamp":"2024-09-16T07:33:52.925999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T07:33:55.961578+0000","last_change":"2024-09-16T07:33:55.964565+0000","last_active":"2024-09-16T07:33:55.961578+0000","last_peered":"2024-09-16T07:33:55.961578+0000","last_clean":"2024-09-16T07:33:55.961578+0000","last_became_active":"2024-09-16T07:33:54.001528+0000","last_became_peered":"2024-09-16T07:33:54.001528+0000","last_unstale":"2024-09-16T07:33:55.961578+0000","last_undegraded":"2024-09-16T07:33:55.961578+0000","last_fullsized":"2024-09-16T07:33:55.961578+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_clean_scrub_stamp":"2024-09-16T07:33:52.925999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T07:33:55.958416+0000","last_change":"2024-09-16T07:33:55.961854+0000","last_active":"2024-09-16T07:33:55.958416+0000","last_peered":"2024-09-16T07:33:55.958416+0000","last_clean":"2024-09-16T07:33:55.958416+0000","last_became_active":"2024-09-16T07:33:53.989047+0000","last_became_peered":"2024-09-16T07:33:53.989047+0000","last_unstale":"2024-09-16T07:33:55.958416+0000","last_undegraded":"2024-09-16T07:33:55.958416+0000","last_fullsized":"2024-09-16T07:33:55.958416+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_clean_scrub_stamp":"2024-09-16T07:33:52.925999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T07:33:55.962135+0000","last_change":"2024-09-16T07:33:55.962135+0000","last_active":"2024-09-16T07:33:55.962135+0000","last_peered":"2024-09-16T07:33:55.962135+0000","last_clean":"2024-09-16T07:33:55.962135+0000","last_became_active":"2024-09-16T07:33:53.989661+0000","last_became_peered":"2024-09-16T07:33:53.989661+0000","last_unstale":"2024-09-16T07:33:55.962135+0000","last_undegraded":"2024-09-16T07:33:55.962135+0000","last_fullsized":"2024-09-16T07:33:55.962135+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_clean_scrub_stamp":"2024-09-16T07:33:52.925999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T07:33:55.959652+0000","last_change":"2024-09-16T07:33:55.962959+0000","last_active":"2024-09-16T07:33:55.959652+0000","last_peered":"2024-09-16T07:33:55.959652+0000","last_clean":"2024-09-16T07:33:55.959652+0000","last_became_active":"2024-09-16T07:33:54.001165+0000","last_became_peered":"2024-09-16T07:33:54.001165+0000","last_unstale":"2024-09-16T07:33:55.959652+0000","last_undegraded":"2024-09-16T07:33:55.959652+0000","last_fullsized":"2024-09-16T07:33:55.959652+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_clean_scrub_stamp":"2024-09-16T07:33:52.925999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T07:33:55.959537+0000","last_change":"2024-09-16T07:33:55.962311+0000","last_active":"2024-09-16T07:33:55.959537+0000","last_peered":"2024-09-16T07:33:55.959537+0000","last_clean":"2024-09-16T07:33:55.959537+0000","last_became_active":"2024-09-16T07:33:53.998493+0000","last_became_peered":"2024-09-16T07:33:53.998493+0000","last_unstale":"2024-09-16T07:33:55.959537+0000","last_undegraded":"2024-09-16T07:33:55.959537+0000","last_fullsized":"2024-09-16T07:33:55.959537+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_clean_scrub_stamp":"2024-09-16T07:33:52.925999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T07:33:55.962732+0000","last_change":"2024-09-16T07:33:55.965013+0000","last_active":"2024-09-16T07:33:55.962732+0000","last_peered":"2024-09-16T07:33:55.962732+0000","last_clean":"2024-09-16T07:33:55.962732+0000","last_became_active":"2024-09-16T07:33:54.007370+0000","last_became_peered":"2024-09-16T07:33:54.007370+0000","last_unstale":"2024-09-16T07:33:55.962732+0000","last_undegraded":"2024-09-16T07:33:55.962732+0000","last_fullsized":"2024-09-16T07:33:55.962732+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_clean_scrub_stamp":"2024-09-16T07:33:52.925999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":87,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T07:33:55.958796+0000","last_change":"2024-09-16T07:33:51.972549+0000","last_active":"2024-09-16T07:33:55.958796+0000","last_peered":"2024-09-16T07:33:55.958796+0000","last_clean":"2024-09-16T07:33:55.958796+0000","last_became_active":"2024-09-16T07:33:51.963446+0000","last_became_peered":"2024-09-16T07:33:51.963446+0000","last_unstale":"2024-09-16T07:33:55.958796+0000","last_undegraded":"2024-09-16T07:33:55.958796+0000","last_fullsized":"2024-09-16T07:33:55.958796+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:50.923539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:50.923539+0000","last_clean_scrub_stamp":"2024-09-16T07:33:50.923539+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30044,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27032,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344808,"statfs":{"total":96636764160,"available":96609083392,"internally_reserved":0,"allocated":188416,"data_stored":624121,"data_compressed":30044,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26960,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344880,"statfs":{"total":96636764160,"available":96609157120,"internally_reserved":0,"allocated":131072,"data_stored":33772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26956,"kb_used_data":124,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344884,"statfs":{"total":96636764160,"available":96609161216,"internally_reserved":0,"allocated":126976,"data_stored":33753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27036,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344804,"statfs":{"total":96636764160,"available":96609079296,"internally_reserved":0,"allocated":192512,"data_stored":624140,"data_compressed":30044,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30044,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:33:58.243 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:33:58.350 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.347+0000 7faead8fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:58.351 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.352+0000 7faead8fd640 1 Processor -- start 2024-09-16T07:33:58.351 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.352+0000 7faead8fd640 1 -- start start 2024-09-16T07:33:58.353 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.353+0000 7faead8fd640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7faea80a26d0 0x7faea8131000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:58.353 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.353+0000 7faead8fd640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faea8130bb0 con 0x7faea80a2150 2024-09-16T07:33:58.353 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.353+0000 7faead8fd640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7faea809fb00 con 0x7faea80a26d0 2024-09-16T07:33:58.353 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.353+0000 7faea6ffd640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7faea80a26d0 0x7faea8131000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:58.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.354+0000 7faea6ffd640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7faea80a26d0 0x7faea8131000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55660/0 (socket says 172.21.15.121:55660) 2024-09-16T07:33:58.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.354+0000 7faea6ffd640 1 -- 172.21.15.121:0/3620118270 learned_addr learned my addr 172.21.15.121:0/3620118270 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:33:58.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.354+0000 7fae9e7fc640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7faea80a2150 0x7faea8133fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:57536/0 (socket says 172.21.15.121:57536) 2024-09-16T07:33:58.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.354+0000 7faea6ffd640 1 -- 172.21.15.121:0/3620118270 >> v1:172.21.15.121:6789/0 conn(0x7faea80a2150 legacy=0x7faea8133fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:58.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.354+0000 7faea6ffd640 1 -- 172.21.15.121:0/3620118270 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faea809fc40 con 0x7faea80a26d0 2024-09-16T07:33:58.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.354+0000 7faea67fc640 1 -- 172.21.15.121:0/3620118270 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4115432960 0 0) 0x7faea8130bb0 con 0x7faea80a2150 2024-09-16T07:33:58.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.354+0000 7faea6ffd640 1 --2- 172.21.15.121:0/3620118270 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faea80a26d0 0x7faea8131000 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceb531c9f8de26e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:58.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.354+0000 7faea67fc640 1 -- 172.21.15.121:0/3620118270 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fae98009e50 con 0x7faea80a26d0 2024-09-16T07:33:58.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.354+0000 7faea67fc640 1 -- 172.21.15.121:0/3620118270 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fae9800e230 con 0x7faea80a26d0 2024-09-16T07:33:58.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.354+0000 7faea67fc640 1 -- 172.21.15.121:0/3620118270 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fae9800e4d0 con 0x7faea80a26d0 2024-09-16T07:33:58.355 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.355+0000 7faead8fd640 1 -- 172.21.15.121:0/3620118270 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faea80a26d0 msgr2=0x7faea8131000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:58.355 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.355+0000 7faead8fd640 1 --2- 172.21.15.121:0/3620118270 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faea80a26d0 0x7faea8131000 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:58.355 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.355+0000 7faead8fd640 1 -- 172.21.15.121:0/3620118270 shutdown_connections 2024-09-16T07:33:58.356 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.355+0000 7faead8fd640 1 --2- 172.21.15.121:0/3620118270 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faea80a26d0 0x7faea8131000 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:58.356 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.355+0000 7faead8fd640 1 -- 172.21.15.121:0/3620118270 >> 172.21.15.121:0/3620118270 conn(0x7faea80a3310 msgr2=0x7faea80a3720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:58.356 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.355+0000 7faead8fd640 1 -- 172.21.15.121:0/3620118270 shutdown_connections 2024-09-16T07:33:58.356 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.355+0000 7faead8fd640 1 -- 172.21.15.121:0/3620118270 wait complete. 2024-09-16T07:33:58.356 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.355+0000 7faead8fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:58.356 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.356+0000 7faead8fd640 1 Processor -- start 2024-09-16T07:33:58.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.357+0000 7faead8fd640 1 -- start start 2024-09-16T07:33:58.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.358+0000 7faead8fd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faea80a2150 0x7faea811c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:58.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.358+0000 7faead8fd640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7faea811e650 con 0x7faea80a2150 2024-09-16T07:33:58.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.358+0000 7faea6ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faea80a2150 0x7faea811c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:58.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.358+0000 7faea6ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faea80a2150 0x7faea811c8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55666/0 (socket says 172.21.15.121:55666) 2024-09-16T07:33:58.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.358+0000 7faea6ffd640 1 -- 172.21.15.121:0/1642943108 learned_addr learned my addr 172.21.15.121:0/1642943108 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:33:58.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.358+0000 7faea6ffd640 1 -- 172.21.15.121:0/1642943108 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faea809f170 con 0x7faea80a2150 2024-09-16T07:33:58.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.358+0000 7faea6ffd640 1 --2- 172.21.15.121:0/1642943108 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faea80a2150 0x7faea811c8f0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:58.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.358+0000 7faea4ff9640 1 -- 172.21.15.121:0/1642943108 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fae9800edc0 con 0x7faea80a2150 2024-09-16T07:33:58.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.358+0000 7faea4ff9640 1 -- 172.21.15.121:0/1642943108 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fae98015420 con 0x7faea80a2150 2024-09-16T07:33:58.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.358+0000 7faead8fd640 1 -- 172.21.15.121:0/1642943108 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faea8074f60 con 0x7faea80a2150 2024-09-16T07:33:58.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.358+0000 7faea4ff9640 1 -- 172.21.15.121:0/1642943108 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fae980156c0 con 0x7faea80a2150 2024-09-16T07:33:58.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.358+0000 7faead8fd640 1 -- 172.21.15.121:0/1642943108 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faea811fd80 con 0x7faea80a2150 2024-09-16T07:33:58.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.359+0000 7faea4ff9640 1 -- 172.21.15.121:0/1642943108 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fae98015870 con 0x7faea80a2150 2024-09-16T07:33:58.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.359+0000 7faead8fd640 1 -- 172.21.15.121:0/1642943108 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faea8134ae0 con 0x7faea80a2150 2024-09-16T07:33:58.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.360+0000 7faea4ff9640 1 --2- 172.21.15.121:0/1642943108 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fae8803e960 0x7fae88040e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:58.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.360+0000 7faea4ff9640 1 -- 172.21.15.121:0/1642943108 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7fae98050e30 con 0x7faea80a2150 2024-09-16T07:33:58.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.360+0000 7fae9e7fc640 1 --2- 172.21.15.121:0/1642943108 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fae8803e960 0x7fae88040e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:58.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.361+0000 7fae9e7fc640 1 --2- 172.21.15.121:0/1642943108 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fae8803e960 0x7fae88040e70 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:58.364 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.365+0000 7faea4ff9640 1 -- 172.21.15.121:0/1642943108 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fae98014c10 con 0x7faea80a2150 2024-09-16T07:33:58.537 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.538+0000 7faead8fd640 1 -- 172.21.15.121:0/1642943108 --> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7faea8120330 con 0x7fae8803e960 2024-09-16T07:33:58.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.539+0000 7faea4ff9640 1 -- 172.21.15.121:0/1642943108 <== mgr.4102 v2:172.21.15.172:6800/643901738 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31130 (crc 0 0 0) 0x7faea8120330 con 0x7fae8803e960 2024-09-16T07:33:58.539 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:33:58.539 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-09-16T07:33:58.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.541+0000 7faead8fd640 1 -- 172.21.15.121:0/1642943108 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fae8803e960 msgr2=0x7fae88040e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:58.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.541+0000 7faead8fd640 1 --2- 172.21.15.121:0/1642943108 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fae8803e960 0x7fae88040e70 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:58.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.541+0000 7faead8fd640 1 -- 172.21.15.121:0/1642943108 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faea80a2150 msgr2=0x7faea811c8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:58.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.541+0000 7faead8fd640 1 --2- 172.21.15.121:0/1642943108 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faea80a2150 0x7faea811c8f0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:58.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.541+0000 7faead8fd640 1 -- 172.21.15.121:0/1642943108 shutdown_connections 2024-09-16T07:33:58.542 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.542+0000 7faead8fd640 1 --2- 172.21.15.121:0/1642943108 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fae8803e960 0x7fae88040e70 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:58.542 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.542+0000 7faead8fd640 1 --2- 172.21.15.121:0/1642943108 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faea80a2150 0x7faea811c8f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:58.542 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.542+0000 7faead8fd640 1 -- 172.21.15.121:0/1642943108 >> 172.21.15.121:0/1642943108 conn(0x7faea80a3310 msgr2=0x7faea8130dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:58.542 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.542+0000 7faead8fd640 1 -- 172.21.15.121:0/1642943108 shutdown_connections 2024-09-16T07:33:58.542 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.542+0000 7faead8fd640 1 -- 172.21.15.121:0/1642943108 wait complete. 2024-09-16T07:33:58.552 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2024-09-16T07:33:57.428038+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":107984,"kb_used_data":624,"kb_used_omap":0,"kb_used_meta":107264,"kb_avail":377379376,"statfs":{"total":386547056640,"available":386436481024,"internally_reserved":0,"allocated":638976,"data_stored":1315786,"data_compressed":60088,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":109838336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T07:33:55.958430+0000","last_change":"2024-09-16T07:33:55.962652+0000","last_active":"2024-09-16T07:33:55.958430+0000","last_peered":"2024-09-16T07:33:55.958430+0000","last_clean":"2024-09-16T07:33:55.958430+0000","last_became_active":"2024-09-16T07:33:53.988604+0000","last_became_peered":"2024-09-16T07:33:53.988604+0000","last_unstale":"2024-09-16T07:33:55.958430+0000","last_undegraded":"2024-09-16T07:33:55.958430+0000","last_fullsized":"2024-09-16T07:33:55.958430+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_clean_scrub_stamp":"2024-09-16T07:33:52.925999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T07:33:55.961692+0000","last_change":"2024-09-16T07:33:55.963562+0000","last_active":"2024-09-16T07:33:55.961692+0000","last_peered":"2024-09-16T07:33:55.961692+0000","last_clean":"2024-09-16T07:33:55.961692+0000","last_became_active":"2024-09-16T07:33:53.999244+0000","last_became_peered":"2024-09-16T07:33:53.999244+0000","last_unstale":"2024-09-16T07:33:55.961692+0000","last_undegraded":"2024-09-16T07:33:55.961692+0000","last_fullsized":"2024-09-16T07:33:55.961692+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_clean_scrub_stamp":"2024-09-16T07:33:52.925999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T07:33:55.961578+0000","last_change":"2024-09-16T07:33:55.964565+0000","last_active":"2024-09-16T07:33:55.961578+0000","last_peered":"2024-09-16T07:33:55.961578+0000","last_clean":"2024-09-16T07:33:55.961578+0000","last_became_active":"2024-09-16T07:33:54.001528+0000","last_became_peered":"2024-09-16T07:33:54.001528+0000","last_unstale":"2024-09-16T07:33:55.961578+0000","last_undegraded":"2024-09-16T07:33:55.961578+0000","last_fullsized":"2024-09-16T07:33:55.961578+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_clean_scrub_stamp":"2024-09-16T07:33:52.925999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T07:33:55.958416+0000","last_change":"2024-09-16T07:33:55.961854+0000","last_active":"2024-09-16T07:33:55.958416+0000","last_peered":"2024-09-16T07:33:55.958416+0000","last_clean":"2024-09-16T07:33:55.958416+0000","last_became_active":"2024-09-16T07:33:53.989047+0000","last_became_peered":"2024-09-16T07:33:53.989047+0000","last_unstale":"2024-09-16T07:33:55.958416+0000","last_undegraded":"2024-09-16T07:33:55.958416+0000","last_fullsized":"2024-09-16T07:33:55.958416+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_clean_scrub_stamp":"2024-09-16T07:33:52.925999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T07:33:55.962135+0000","last_change":"2024-09-16T07:33:55.962135+0000","last_active":"2024-09-16T07:33:55.962135+0000","last_peered":"2024-09-16T07:33:55.962135+0000","last_clean":"2024-09-16T07:33:55.962135+0000","last_became_active":"2024-09-16T07:33:53.989661+0000","last_became_peered":"2024-09-16T07:33:53.989661+0000","last_unstale":"2024-09-16T07:33:55.962135+0000","last_undegraded":"2024-09-16T07:33:55.962135+0000","last_fullsized":"2024-09-16T07:33:55.962135+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_clean_scrub_stamp":"2024-09-16T07:33:52.925999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T07:33:55.959652+0000","last_change":"2024-09-16T07:33:55.962959+0000","last_active":"2024-09-16T07:33:55.959652+0000","last_peered":"2024-09-16T07:33:55.959652+0000","last_clean":"2024-09-16T07:33:55.959652+0000","last_became_active":"2024-09-16T07:33:54.001165+0000","last_became_peered":"2024-09-16T07:33:54.001165+0000","last_unstale":"2024-09-16T07:33:55.959652+0000","last_undegraded":"2024-09-16T07:33:55.959652+0000","last_fullsized":"2024-09-16T07:33:55.959652+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_clean_scrub_stamp":"2024-09-16T07:33:52.925999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T07:33:55.959537+0000","last_change":"2024-09-16T07:33:55.962311+0000","last_active":"2024-09-16T07:33:55.959537+0000","last_peered":"2024-09-16T07:33:55.959537+0000","last_clean":"2024-09-16T07:33:55.959537+0000","last_became_active":"2024-09-16T07:33:53.998493+0000","last_became_peered":"2024-09-16T07:33:53.998493+0000","last_unstale":"2024-09-16T07:33:55.959537+0000","last_undegraded":"2024-09-16T07:33:55.959537+0000","last_fullsized":"2024-09-16T07:33:55.959537+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_clean_scrub_stamp":"2024-09-16T07:33:52.925999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T07:33:55.962732+0000","last_change":"2024-09-16T07:33:55.965013+0000","last_active":"2024-09-16T07:33:55.962732+0000","last_peered":"2024-09-16T07:33:55.962732+0000","last_clean":"2024-09-16T07:33:55.962732+0000","last_became_active":"2024-09-16T07:33:54.007370+0000","last_became_peered":"2024-09-16T07:33:54.007370+0000","last_unstale":"2024-09-16T07:33:55.962732+0000","last_undegraded":"2024-09-16T07:33:55.962732+0000","last_fullsized":"2024-09-16T07:33:55.962732+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_clean_scrub_stamp":"2024-09-16T07:33:52.925999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":87,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T07:33:55.958796+0000","last_change":"2024-09-16T07:33:51.972549+0000","last_active":"2024-09-16T07:33:55.958796+0000","last_peered":"2024-09-16T07:33:55.958796+0000","last_clean":"2024-09-16T07:33:55.958796+0000","last_became_active":"2024-09-16T07:33:51.963446+0000","last_became_peered":"2024-09-16T07:33:51.963446+0000","last_unstale":"2024-09-16T07:33:55.958796+0000","last_undegraded":"2024-09-16T07:33:55.958796+0000","last_fullsized":"2024-09-16T07:33:55.958796+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:50.923539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:50.923539+0000","last_clean_scrub_stamp":"2024-09-16T07:33:50.923539+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30044,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27032,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344808,"statfs":{"total":96636764160,"available":96609083392,"internally_reserved":0,"allocated":188416,"data_stored":624121,"data_compressed":30044,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26960,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344880,"statfs":{"total":96636764160,"available":96609157120,"internally_reserved":0,"allocated":131072,"data_stored":33772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26956,"kb_used_data":124,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344884,"statfs":{"total":96636764160,"available":96609161216,"internally_reserved":0,"allocated":126976,"data_stored":33753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27036,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344804,"statfs":{"total":96636764160,"available":96609079296,"internally_reserved":0,"allocated":192512,"data_stored":624140,"data_compressed":30044,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30044,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:33:58.553 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-16T07:33:58.553 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-16T07:33:58.553 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-16T07:33:58.553 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-16T07:33:58.661 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.659+0000 7fef6f591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:58.661 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.662+0000 7fef6f591640 1 Processor -- start 2024-09-16T07:33:58.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.663+0000 7fef6f591640 1 -- start start 2024-09-16T07:33:58.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.664+0000 7fef6f591640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fef6809ca50 0x7fef6809ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:58.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.664+0000 7fef6f591640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef680a0060 con 0x7fef6809d3a0 2024-09-16T07:33:58.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.664+0000 7fef6f591640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fef6809fd30 con 0x7fef6809ca50 2024-09-16T07:33:58.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.664+0000 7fef6d32d640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fef6809ca50 0x7fef6809ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:58.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.664+0000 7fef6cb2c640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fef6809d3a0 0x7fef68135ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:57552/0 (socket says 172.21.15.121:57552) 2024-09-16T07:33:58.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.664+0000 7fef6d32d640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fef6809ca50 0x7fef6809ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55676/0 (socket says 172.21.15.121:55676) 2024-09-16T07:33:58.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.664+0000 7fef6cb2c640 1 -- 172.21.15.121:0/1311593288 learned_addr learned my addr 172.21.15.121:0/1311593288 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-16T07:33:58.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.664+0000 7fef6d32d640 1 -- 172.21.15.121:0/1311593288 >> v1:172.21.15.121:6789/0 conn(0x7fef6809d3a0 legacy=0x7fef68135ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:58.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.664+0000 7fef6d32d640 1 -- 172.21.15.121:0/1311593288 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef6809e3c0 con 0x7fef6809ca50 2024-09-16T07:33:58.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.664+0000 7fef67fff640 1 -- 172.21.15.121:0/1311593288 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4286970654 0 0) 0x7fef680a0060 con 0x7fef6809d3a0 2024-09-16T07:33:58.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.664+0000 7fef6d32d640 1 --2- 172.21.15.121:0/1311593288 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fef6809ca50 0x7fef6809ce60 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10593e8de4cf1178 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:58.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.664+0000 7fef67fff640 1 -- 172.21.15.121:0/1311593288 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fef58009d80 con 0x7fef6809ca50 2024-09-16T07:33:58.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.664+0000 7fef67fff640 1 -- 172.21.15.121:0/1311593288 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fef5800e230 con 0x7fef6809ca50 2024-09-16T07:33:58.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.665+0000 7fef67fff640 1 -- 172.21.15.121:0/1311593288 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fef5800e4d0 con 0x7fef6809ca50 2024-09-16T07:33:58.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.665+0000 7fef6f591640 1 -- 172.21.15.121:0/1311593288 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fef6809ca50 msgr2=0x7fef6809ce60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:58.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.665+0000 7fef6f591640 1 --2- 172.21.15.121:0/1311593288 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fef6809ca50 0x7fef6809ce60 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:58.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.665+0000 7fef6f591640 1 -- 172.21.15.121:0/1311593288 shutdown_connections 2024-09-16T07:33:58.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.665+0000 7fef6f591640 1 --2- 172.21.15.121:0/1311593288 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fef6809ca50 0x7fef6809ce60 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:58.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.665+0000 7fef6f591640 1 -- 172.21.15.121:0/1311593288 >> 172.21.15.121:0/1311593288 conn(0x7fef680a5230 msgr2=0x7fef680a5640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:58.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.665+0000 7fef6f591640 1 -- 172.21.15.121:0/1311593288 shutdown_connections 2024-09-16T07:33:58.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.665+0000 7fef6f591640 1 -- 172.21.15.121:0/1311593288 wait complete. 2024-09-16T07:33:58.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.666+0000 7fef6f591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:33:58.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.667+0000 7fef6f591640 1 Processor -- start 2024-09-16T07:33:58.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.667+0000 7fef6f591640 1 -- start start 2024-09-16T07:33:58.669 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.668+0000 7fef6f591640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fef6809ca50 0x7fef68124c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:58.669 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.668+0000 7fef6f591640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fef68123510 con 0x7fef6809ca50 2024-09-16T07:33:58.669 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.668+0000 7fef6d32d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fef6809ca50 0x7fef68124c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:58.669 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.668+0000 7fef6d32d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fef6809ca50 0x7fef68124c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55678/0 (socket says 172.21.15.121:55678) 2024-09-16T07:33:58.669 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.668+0000 7fef6d32d640 1 -- 172.21.15.121:0/981125935 learned_addr learned my addr 172.21.15.121:0/981125935 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:33:58.670 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.668+0000 7fef6d32d640 1 -- 172.21.15.121:0/981125935 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef68135e30 con 0x7fef6809ca50 2024-09-16T07:33:58.670 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.668+0000 7fef6d32d640 1 --2- 172.21.15.121:0/981125935 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fef6809ca50 0x7fef68124c50 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:58.670 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.669+0000 7fef65ffb640 1 -- 172.21.15.121:0/981125935 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fef58014620 con 0x7fef6809ca50 2024-09-16T07:33:58.670 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.669+0000 7fef6f591640 1 -- 172.21.15.121:0/981125935 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef68122ec0 con 0x7fef6809ca50 2024-09-16T07:33:58.670 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.669+0000 7fef65ffb640 1 -- 172.21.15.121:0/981125935 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fef58014780 con 0x7fef6809ca50 2024-09-16T07:33:58.670 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.669+0000 7fef65ffb640 1 -- 172.21.15.121:0/981125935 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fef58014a20 con 0x7fef6809ca50 2024-09-16T07:33:58.670 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.669+0000 7fef6f591640 1 -- 172.21.15.121:0/981125935 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef68122bb0 con 0x7fef6809ca50 2024-09-16T07:33:58.670 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.670+0000 7fef6f591640 1 -- 172.21.15.121:0/981125935 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef681252a0 con 0x7fef6809ca50 2024-09-16T07:33:58.670 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.670+0000 7fef65ffb640 1 -- 172.21.15.121:0/981125935 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fef58014c20 con 0x7fef6809ca50 2024-09-16T07:33:58.671 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.670+0000 7fef65ffb640 1 --2- 172.21.15.121:0/981125935 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fef5403e8e0 0x7fef54040df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:58.671 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.670+0000 7fef65ffb640 1 -- 172.21.15.121:0/981125935 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7fef58019040 con 0x7fef6809ca50 2024-09-16T07:33:58.671 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.671+0000 7fef6cb2c640 1 --2- 172.21.15.121:0/981125935 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fef5403e8e0 0x7fef54040df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:58.671 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.671+0000 7fef6cb2c640 1 --2- 172.21.15.121:0/981125935 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fef5403e8e0 0x7fef54040df0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:58.674 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.675+0000 7fef65ffb640 1 -- 172.21.15.121:0/981125935 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fef58011570 con 0x7fef6809ca50 2024-09-16T07:33:58.887 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.888+0000 7fef6f591640 1 -- 172.21.15.121:0/981125935 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fef68125960 con 0x7fef6809ca50 2024-09-16T07:33:58.888 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.888+0000 7fef65ffb640 1 -- 172.21.15.121:0/981125935 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (crc 0 0 0) 0x7fef5800f2a0 con 0x7fef6809ca50 2024-09-16T07:33:58.888 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:33:58.888 INFO:teuthology.orchestra.run.smithi121.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-16T07:33:58.890 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.891+0000 7fef6f591640 1 -- 172.21.15.121:0/981125935 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fef5403e8e0 msgr2=0x7fef54040df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:58.890 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.891+0000 7fef6f591640 1 --2- 172.21.15.121:0/981125935 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fef5403e8e0 0x7fef54040df0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:58.890 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.891+0000 7fef6f591640 1 -- 172.21.15.121:0/981125935 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fef6809ca50 msgr2=0x7fef68124c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:58.891 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.891+0000 7fef6f591640 1 --2- 172.21.15.121:0/981125935 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fef6809ca50 0x7fef68124c50 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:58.891 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.891+0000 7fef6f591640 1 -- 172.21.15.121:0/981125935 shutdown_connections 2024-09-16T07:33:58.891 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.891+0000 7fef6f591640 1 --2- 172.21.15.121:0/981125935 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fef5403e8e0 0x7fef54040df0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:58.891 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.891+0000 7fef6f591640 1 --2- 172.21.15.121:0/981125935 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fef6809ca50 0x7fef68124c50 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:58.891 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.891+0000 7fef6f591640 1 -- 172.21.15.121:0/981125935 >> 172.21.15.121:0/981125935 conn(0x7fef680a5230 msgr2=0x7fef680a74c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:58.891 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.891+0000 7fef6f591640 1 -- 172.21.15.121:0/981125935 shutdown_connections 2024-09-16T07:33:58.891 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:33:58.891+0000 7fef6f591640 1 -- 172.21.15.121:0/981125935 wait complete. 2024-09-16T07:33:58.901 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-16T07:33:58.902 INFO:teuthology.run_tasks:Running task workunit... 2024-09-16T07:33:58.917 INFO:tasks.workunit:Pulling workunits from ref 0325fd3c11a225c0fd9eb38fab88aad1370ad779 2024-09-16T07:33:58.917 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-16T07:33:58.918 DEBUG:teuthology.orchestra.run.smithi121:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-16T07:33:58.933 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T07:33:58.933 INFO:teuthology.orchestra.run.smithi121.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-16T07:33:58.934 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-16T07:33:58.990 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-16T07:33:58.990 DEBUG:teuthology.orchestra.run.smithi121:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-16T07:33:59.045 INFO:tasks.workunit:timeout=3h 2024-09-16T07:33:59.045 INFO:tasks.workunit:cleanup=True 2024-09-16T07:33:59.046 DEBUG:teuthology.orchestra.run.smithi121:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 0325fd3c11a225c0fd9eb38fab88aad1370ad779 2024-09-16T07:33:59.101 INFO:tasks.workunit.client.0.smithi121.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-16T07:34:49.542 INFO:tasks.workunit.client.0.smithi121.stderr:Note: switching to '0325fd3c11a225c0fd9eb38fab88aad1370ad779'. 2024-09-16T07:34:49.542 INFO:tasks.workunit.client.0.smithi121.stderr: 2024-09-16T07:34:49.542 INFO:tasks.workunit.client.0.smithi121.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-16T07:34:49.543 INFO:tasks.workunit.client.0.smithi121.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-16T07:34:49.543 INFO:tasks.workunit.client.0.smithi121.stderr:state without impacting any branches by switching back to a branch. 2024-09-16T07:34:49.543 INFO:tasks.workunit.client.0.smithi121.stderr: 2024-09-16T07:34:49.543 INFO:tasks.workunit.client.0.smithi121.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-16T07:34:49.543 INFO:tasks.workunit.client.0.smithi121.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-16T07:34:49.543 INFO:tasks.workunit.client.0.smithi121.stderr: 2024-09-16T07:34:49.543 INFO:tasks.workunit.client.0.smithi121.stderr: git switch -c 2024-09-16T07:34:49.543 INFO:tasks.workunit.client.0.smithi121.stderr: 2024-09-16T07:34:49.543 INFO:tasks.workunit.client.0.smithi121.stderr:Or undo this operation with: 2024-09-16T07:34:49.543 INFO:tasks.workunit.client.0.smithi121.stderr: 2024-09-16T07:34:49.543 INFO:tasks.workunit.client.0.smithi121.stderr: git switch - 2024-09-16T07:34:49.543 INFO:tasks.workunit.client.0.smithi121.stderr: 2024-09-16T07:34:49.543 INFO:tasks.workunit.client.0.smithi121.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-16T07:34:49.544 INFO:tasks.workunit.client.0.smithi121.stderr: 2024-09-16T07:34:49.544 INFO:tasks.workunit.client.0.smithi121.stderr:HEAD is now at 0325fd3c11a Merge pull request #58530 from zdover23/wip-doc-2024-07-11-radosgw-s3-authentication 2024-09-16T07:34:49.546 DEBUG:teuthology.orchestra.run.smithi121:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-16T07:34:49.612 INFO:tasks.workunit.client.0.smithi121.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-16T07:34:49.614 INFO:tasks.workunit.client.0.smithi121.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-16T07:34:49.614 INFO:tasks.workunit.client.0.smithi121.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-16T07:34:50.300 INFO:tasks.workunit.client.0.smithi121.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-16T07:34:50.370 INFO:tasks.workunit.client.0.smithi121.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-16T07:34:50.411 INFO:tasks.workunit.client.0.smithi121.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-16T07:34:50.412 INFO:tasks.workunit.client.0.smithi121.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-16T07:34:50.412 INFO:tasks.workunit.client.0.smithi121.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-16T07:34:50.451 INFO:tasks.workunit.client.0.smithi121.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-16T07:34:50.455 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-16T07:34:50.455 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-16T07:34:50.511 INFO:tasks.workunit:Running workunits matching rados/test.sh on client.0... 2024-09-16T07:34:50.512 INFO:tasks.workunit:Running workunit rados/test.sh... 2024-09-16T07:34:50.512 DEBUG:teuthology.orchestra.run.smithi121:workunit test rados/test.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0325fd3c11a225c0fd9eb38fab88aad1370ad779 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh --crimson 2024-09-16T07:34:50.571 INFO:tasks.workunit.client.0.smithi121.stderr:+ parallel=1 2024-09-16T07:34:50.571 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' --crimson = --serial ']' 2024-09-16T07:34:50.571 INFO:tasks.workunit.client.0.smithi121.stderr:+ crimson=0 2024-09-16T07:34:50.572 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' --crimson = --crimson ']' 2024-09-16T07:34:50.572 INFO:tasks.workunit.client.0.smithi121.stderr:+ parallel=0 2024-09-16T07:34:50.572 INFO:tasks.workunit.client.0.smithi121.stderr:+ crimson=1 2024-09-16T07:34:50.572 INFO:tasks.workunit.client.0.smithi121.stderr:+ color= 2024-09-16T07:34:50.572 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' -t 1 ']' 2024-09-16T07:34:50.572 INFO:tasks.workunit.client.0.smithi121.stderr:+ trap cleanup EXIT ERR HUP INT QUIT 2024-09-16T07:34:50.572 INFO:tasks.workunit.client.0.smithi121.stderr:+ GTEST_OUTPUT_DIR=/home/ubuntu/cephtest/archive/unit_test_xml_report 2024-09-16T07:34:50.572 INFO:tasks.workunit.client.0.smithi121.stderr:+ mkdir -p /home/ubuntu/cephtest/archive/unit_test_xml_report 2024-09-16T07:34:50.573 INFO:tasks.workunit.client.0.smithi121.stderr:+ declare -A pids 2024-09-16T07:34:50.573 INFO:tasks.workunit.client.0.smithi121.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T07:34:50.573 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T07:34:50.573 INFO:tasks.workunit.client.0.smithi121.stderr:+ ceph_test_rados_api_aio 2024-09-16T07:34:50.590 INFO:tasks.workunit.client.0.smithi121.stdout:Running main() from gmock_main.cc 2024-09-16T07:34:50.590 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] Running 42 tests from 2 test suites. 2024-09-16T07:34:50.590 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment set-up. 2024-09-16T07:34:50.590 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 26 tests from LibRadosAio 2024-09-16T07:34:50.590 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAio.TooBig 2024-09-16T07:34:53.303 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosAio.TooBig (2714 ms) 2024-09-16T07:34:53.303 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAio.SimpleWrite 2024-09-16T07:34:56.322 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosAio.SimpleWrite (3019 ms) 2024-09-16T07:34:56.322 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAio.WaitForSafe 2024-09-16T07:34:59.340 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosAio.WaitForSafe (3018 ms) 2024-09-16T07:34:59.341 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAio.RoundTrip 2024-09-16T07:35:02.351 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosAio.RoundTrip (3011 ms) 2024-09-16T07:35:02.351 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAio.RoundTrip2 2024-09-16T07:35:05.378 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosAio.RoundTrip2 (3027 ms) 2024-09-16T07:35:05.378 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAio.RoundTrip3 2024-09-16T07:35:08.386 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosAio.RoundTrip3 (3008 ms) 2024-09-16T07:35:08.386 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAio.RoundTripAppend 2024-09-16T07:35:11.402 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosAio.RoundTripAppend (3016 ms) 2024-09-16T07:35:11.402 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAio.RemoveTest 2024-09-16T07:35:14.412 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosAio.RemoveTest (3010 ms) 2024-09-16T07:35:14.412 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAio.XattrsRoundTrip 2024-09-16T07:35:17.438 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosAio.XattrsRoundTrip (3025 ms) 2024-09-16T07:35:17.438 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAio.RmXattr 2024-09-16T07:35:20.444 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosAio.RmXattr (3007 ms) 2024-09-16T07:35:20.444 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAio.XattrIter 2024-09-16T07:35:23.463 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosAio.XattrIter (3018 ms) 2024-09-16T07:35:23.463 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAio.IsComplete 2024-09-16T07:35:26.474 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosAio.IsComplete (3012 ms) 2024-09-16T07:35:26.475 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAio.IsSafe 2024-09-16T07:35:29.489 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosAio.IsSafe (3015 ms) 2024-09-16T07:35:29.489 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAio.ReturnValue 2024-09-16T07:35:32.506 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosAio.ReturnValue (3017 ms) 2024-09-16T07:35:32.507 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAio.Flush 2024-09-16T07:35:35.533 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosAio.Flush (3026 ms) 2024-09-16T07:35:35.533 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAio.FlushAsync 2024-09-16T07:35:38.539 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosAio.FlushAsync (3007 ms) 2024-09-16T07:35:38.539 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAio.RoundTripWriteFull 2024-09-16T07:35:41.558 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosAio.RoundTripWriteFull (3019 ms) 2024-09-16T07:35:41.558 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAio.RoundTripWriteSame 2024-09-16T07:35:44.294 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosAio.RoundTripWriteSame (2735 ms) 2024-09-16T07:35:44.294 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAio.SimpleStat 2024-09-16T07:35:47.290 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosAio.SimpleStat (2996 ms) 2024-09-16T07:35:47.290 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAio.OperateMtime 2024-09-16T07:35:50.322 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosAio.OperateMtime (3033 ms) 2024-09-16T07:35:50.323 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAio.Operate2Mtime 2024-09-16T07:35:53.349 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosAio.Operate2Mtime (3026 ms) 2024-09-16T07:35:53.349 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAio.SimpleStatNS 2024-09-16T07:35:56.360 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosAio.SimpleStatNS (3011 ms) 2024-09-16T07:35:56.360 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAio.StatRemove 2024-09-16T07:35:59.373 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosAio.StatRemove (3013 ms) 2024-09-16T07:35:59.373 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAio.ExecuteClass 2024-09-16T07:36:02.384 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosAio.ExecuteClass (3011 ms) 2024-09-16T07:36:02.384 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAio.MultiWrite 2024-09-16T07:36:05.399 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosAio.MultiWrite (3016 ms) 2024-09-16T07:36:05.399 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAio.AioUnlock 2024-09-16T07:36:08.296 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosAio.AioUnlock (2896 ms) 2024-09-16T07:36:08.296 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 26 tests from LibRadosAio (77706 ms total) 2024-09-16T07:36:08.296 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:36:08.296 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 16 tests from LibRadosAioEC 2024-09-16T07:36:08.296 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAioEC.SimpleWrite 2024-09-16T07:36:08.296 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio.cc:1100: Skipped 2024-09-16T07:36:08.297 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:36:08.297 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosAioEC.SimpleWrite (0 ms) 2024-09-16T07:36:08.297 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAioEC.WaitForComplete 2024-09-16T07:36:08.297 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio.cc:1132: Skipped 2024-09-16T07:36:08.297 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:36:08.297 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosAioEC.WaitForComplete (0 ms) 2024-09-16T07:36:08.297 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAioEC.RoundTrip 2024-09-16T07:36:08.297 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio.cc:1149: Skipped 2024-09-16T07:36:08.297 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:36:08.297 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosAioEC.RoundTrip (0 ms) 2024-09-16T07:36:08.297 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAioEC.RoundTrip2 2024-09-16T07:36:08.297 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio.cc:1182: Skipped 2024-09-16T07:36:08.297 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:36:08.298 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosAioEC.RoundTrip2 (0 ms) 2024-09-16T07:36:08.298 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAioEC.RoundTripAppend 2024-09-16T07:36:08.298 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio.cc:1215: Skipped 2024-09-16T07:36:08.298 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:36:08.298 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripAppend (0 ms) 2024-09-16T07:36:08.298 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAioEC.IsComplete 2024-09-16T07:36:08.298 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio.cc:1286: Skipped 2024-09-16T07:36:08.298 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:36:08.298 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosAioEC.IsComplete (0 ms) 2024-09-16T07:36:08.298 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAioEC.IsSafe 2024-09-16T07:36:08.298 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio.cc:1326: Skipped 2024-09-16T07:36:08.298 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:36:08.298 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosAioEC.IsSafe (0 ms) 2024-09-16T07:36:08.299 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAioEC.ReturnValue 2024-09-16T07:36:08.299 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio.cc:1366: Skipped 2024-09-16T07:36:08.299 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:36:08.299 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosAioEC.ReturnValue (0 ms) 2024-09-16T07:36:08.299 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAioEC.Flush 2024-09-16T07:36:08.299 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio.cc:1385: Skipped 2024-09-16T07:36:08.299 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:36:08.299 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosAioEC.Flush (0 ms) 2024-09-16T07:36:08.299 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAioEC.FlushAsync 2024-09-16T07:36:08.299 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio.cc:1415: Skipped 2024-09-16T07:36:08.299 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:36:08.299 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosAioEC.FlushAsync (0 ms) 2024-09-16T07:36:08.300 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAioEC.RoundTripWriteFull 2024-09-16T07:36:08.300 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio.cc:1454: Skipped 2024-09-16T07:36:08.300 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:36:08.300 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFull (0 ms) 2024-09-16T07:36:08.300 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAioEC.SimpleStat 2024-09-16T07:36:08.300 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio.cc:1498: Skipped 2024-09-16T07:36:08.300 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:36:08.300 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStat (0 ms) 2024-09-16T07:36:08.300 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAioEC.SimpleStatNS 2024-09-16T07:36:08.300 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio.cc:1532: Skipped 2024-09-16T07:36:08.300 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:36:08.300 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatNS (0 ms) 2024-09-16T07:36:08.300 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAioEC.StatRemove 2024-09-16T07:36:08.300 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio.cc:1593: Skipped 2024-09-16T07:36:08.301 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:36:08.301 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosAioEC.StatRemove (0 ms) 2024-09-16T07:36:08.301 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAioEC.ExecuteClass 2024-09-16T07:36:08.301 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio.cc:1649: Skipped 2024-09-16T07:36:08.301 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:36:08.301 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosAioEC.ExecuteClass (0 ms) 2024-09-16T07:36:08.301 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAioEC.MultiWrite 2024-09-16T07:36:08.301 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio.cc:1681: Skipped 2024-09-16T07:36:08.301 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:36:08.301 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosAioEC.MultiWrite (0 ms) 2024-09-16T07:36:08.301 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 16 tests from LibRadosAioEC (0 ms total) 2024-09-16T07:36:08.301 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:36:08.301 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment tear-down 2024-09-16T07:36:08.302 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] 42 tests from 2 test suites ran. (77706 ms total) 2024-09-16T07:36:08.302 INFO:tasks.workunit.client.0.smithi121.stdout:[ PASSED ] 26 tests. 2024-09-16T07:36:08.302 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] 16 tests, listed below: 2024-09-16T07:36:08.302 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosAioEC.SimpleWrite 2024-09-16T07:36:08.302 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosAioEC.WaitForComplete 2024-09-16T07:36:08.302 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosAioEC.RoundTrip 2024-09-16T07:36:08.302 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosAioEC.RoundTrip2 2024-09-16T07:36:08.302 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripAppend 2024-09-16T07:36:08.302 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosAioEC.IsComplete 2024-09-16T07:36:08.302 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosAioEC.IsSafe 2024-09-16T07:36:08.302 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosAioEC.ReturnValue 2024-09-16T07:36:08.302 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosAioEC.Flush 2024-09-16T07:36:08.302 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosAioEC.FlushAsync 2024-09-16T07:36:08.303 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFull 2024-09-16T07:36:08.303 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStat 2024-09-16T07:36:08.303 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatNS 2024-09-16T07:36:08.303 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosAioEC.StatRemove 2024-09-16T07:36:08.303 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosAioEC.ExecuteClass 2024-09-16T07:36:08.303 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosAioEC.MultiWrite 2024-09-16T07:36:08.303 INFO:tasks.workunit.client.0.smithi121.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T07:36:08.304 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T07:36:08.304 INFO:tasks.workunit.client.0.smithi121.stderr:+ ceph_test_rados_api_aio_pp 2024-09-16T07:36:08.320 INFO:tasks.workunit.client.0.smithi121.stdout:Running main() from gmock_main.cc 2024-09-16T07:36:08.320 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] Running 57 tests from 4 test suites. 2024-09-16T07:36:08.320 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment set-up. 2024-09-16T07:36:08.320 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 32 tests from LibRadosAio 2024-09-16T07:36:08.320 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAio.TooBigPP 2024-09-16T07:36:11.306 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosAio.TooBigPP (2986 ms) 2024-09-16T07:36:11.306 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAio.PoolQuotaPP 2024-09-16T07:36:29.345 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosAio.PoolQuotaPP (18038 ms) 2024-09-16T07:36:29.345 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAio.SimpleWritePP 2024-09-16T07:36:35.371 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosAio.SimpleWritePP (6027 ms) 2024-09-16T07:36:35.371 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAio.WaitForSafePP 2024-09-16T07:36:38.384 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosAio.WaitForSafePP (3013 ms) 2024-09-16T07:36:38.384 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAio.RoundTripPP 2024-09-16T07:36:41.405 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosAio.RoundTripPP (3021 ms) 2024-09-16T07:36:41.405 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAio.RoundTripPP2 2024-09-16T07:36:44.418 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosAio.RoundTripPP2 (3013 ms) 2024-09-16T07:36:44.419 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAio.RoundTripPP3 2024-09-16T07:36:47.305 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosAio.RoundTripPP3 (2886 ms) 2024-09-16T07:36:47.305 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAio.RoundTripSparseReadPP 2024-09-16T07:36:50.310 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosAio.RoundTripSparseReadPP (3006 ms) 2024-09-16T07:36:50.310 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAio.IsCompletePP 2024-09-16T07:36:53.327 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosAio.IsCompletePP (3017 ms) 2024-09-16T07:36:53.327 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAio.IsSafePP 2024-09-16T07:36:56.342 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosAio.IsSafePP (3015 ms) 2024-09-16T07:36:56.342 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAio.ReturnValuePP 2024-09-16T07:36:59.353 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosAio.ReturnValuePP (3011 ms) 2024-09-16T07:36:59.353 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAio.FlushPP 2024-09-16T07:37:02.374 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosAio.FlushPP (3021 ms) 2024-09-16T07:37:02.374 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAio.FlushAsyncPP 2024-09-16T07:37:05.393 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosAio.FlushAsyncPP (3018 ms) 2024-09-16T07:37:05.393 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAio.RoundTripWriteFullPP 2024-09-16T07:37:08.308 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosAio.RoundTripWriteFullPP (2915 ms) 2024-09-16T07:37:08.308 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAio.RoundTripWriteFullPP2 2024-09-16T07:37:11.322 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosAio.RoundTripWriteFullPP2 (3014 ms) 2024-09-16T07:37:11.322 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAio.RoundTripWriteSamePP 2024-09-16T07:37:14.332 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosAio.RoundTripWriteSamePP (3010 ms) 2024-09-16T07:37:14.332 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAio.RoundTripWriteSamePP2 2024-09-16T07:37:17.311 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosAio.RoundTripWriteSamePP2 (2980 ms) 2024-09-16T07:37:17.311 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAio.SimpleStatPPNS 2024-09-16T07:37:20.368 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosAio.SimpleStatPPNS (3057 ms) 2024-09-16T07:37:20.369 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAio.SimpleStatPP 2024-09-16T07:37:23.410 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosAio.SimpleStatPP (3042 ms) 2024-09-16T07:37:23.410 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAio.OperateMtime 2024-09-16T07:37:26.422 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosAio.OperateMtime (3011 ms) 2024-09-16T07:37:26.422 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAio.OperateMtime2 2024-09-16T07:37:29.312 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosAio.OperateMtime2 (2891 ms) 2024-09-16T07:37:29.312 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAio.StatRemovePP 2024-09-16T07:37:32.323 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosAio.StatRemovePP (3011 ms) 2024-09-16T07:37:32.323 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAio.ExecuteClassPP 2024-09-16T07:37:35.336 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosAio.ExecuteClassPP (3013 ms) 2024-09-16T07:37:35.337 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAio.OmapPP 2024-09-16T07:37:38.349 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosAio.OmapPP (3013 ms) 2024-09-16T07:37:38.349 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAio.MultiWritePP 2024-09-16T07:37:41.363 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosAio.MultiWritePP (3014 ms) 2024-09-16T07:37:41.363 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAio.AioUnlockPP 2024-09-16T07:37:44.378 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosAio.AioUnlockPP (3015 ms) 2024-09-16T07:37:44.378 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAio.RoundTripAppendPP 2024-09-16T07:37:47.314 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosAio.RoundTripAppendPP (2936 ms) 2024-09-16T07:37:47.314 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAio.RacingRemovePP 2024-09-16T07:37:50.395 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosAio.RacingRemovePP (3081 ms) 2024-09-16T07:37:50.395 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAio.RoundTripCmpExtPP 2024-09-16T07:37:53.423 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosAio.RoundTripCmpExtPP (3027 ms) 2024-09-16T07:37:53.423 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAio.RoundTripCmpExtPP2 2024-09-16T07:37:56.431 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosAio.RoundTripCmpExtPP2 (3008 ms) 2024-09-16T07:37:56.431 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAio.PoolEIOFlag 2024-09-16T07:37:58.815 INFO:tasks.workunit.client.0.smithi121.stdout:setting pool EIO 2024-09-16T07:38:08.490 INFO:tasks.workunit.client.0.smithi121.stdout:waiting for 898 2024-09-16T07:38:09.490 INFO:tasks.workunit.client.0.smithi121.stdout:waiting for 898 2024-09-16T07:38:10.490 INFO:tasks.workunit.client.0.smithi121.stdout:waiting for 898 2024-09-16T07:38:11.490 INFO:tasks.workunit.client.0.smithi121.stdout:max_success 102, min_failed 103 2024-09-16T07:38:12.462 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosAio.PoolEIOFlag (16031 ms) 2024-09-16T07:38:12.462 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAio.MultiReads 2024-09-16T07:38:12.463 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:2427: Skipped 2024-09-16T07:38:12.463 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:12.463 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosAio.MultiReads (0 ms) 2024-09-16T07:38:12.463 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 32 tests from LibRadosAio (124142 ms total) 2024-09-16T07:38:12.463 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:38:12.463 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 4 tests from LibRadosAioPP 2024-09-16T07:38:12.463 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAioPP.ReadIntoBufferlist 2024-09-16T07:38:15.477 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosAioPP.ReadIntoBufferlist (3015 ms) 2024-09-16T07:38:15.478 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAioPP.XattrsRoundTripPP 2024-09-16T07:38:24.348 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosAioPP.XattrsRoundTripPP (8871 ms) 2024-09-16T07:38:24.349 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAioPP.RmXattrPP 2024-09-16T07:38:39.327 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosAioPP.RmXattrPP (14979 ms) 2024-09-16T07:38:39.327 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAioPP.RemoveTestPP 2024-09-16T07:38:42.338 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosAioPP.RemoveTestPP (3010 ms) 2024-09-16T07:38:42.338 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 4 tests from LibRadosAioPP (29875 ms total) 2024-09-16T07:38:42.338 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:38:42.338 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 1 test from LibRadosIoPP 2024-09-16T07:38:42.338 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosIoPP.XattrListPP 2024-09-16T07:38:45.365 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosIoPP.XattrListPP (3026 ms) 2024-09-16T07:38:45.366 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 1 test from LibRadosIoPP (3026 ms total) 2024-09-16T07:38:45.366 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:38:45.366 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 20 tests from LibRadosAioEC 2024-09-16T07:38:45.366 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAioEC.SimpleWritePP 2024-09-16T07:38:45.366 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:1384: Skipped 2024-09-16T07:38:45.366 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:45.366 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosAioEC.SimpleWritePP (0 ms) 2024-09-16T07:38:45.366 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAioEC.WaitForSafePP 2024-09-16T07:38:45.366 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:1419: Skipped 2024-09-16T07:38:45.366 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:45.366 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosAioEC.WaitForSafePP (0 ms) 2024-09-16T07:38:45.367 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAioEC.RoundTripPP 2024-09-16T07:38:45.367 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:1436: Skipped 2024-09-16T07:38:45.367 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:45.367 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP (0 ms) 2024-09-16T07:38:45.367 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAioEC.RoundTripPP2 2024-09-16T07:38:45.367 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:1467: Skipped 2024-09-16T07:38:45.367 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:45.367 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP2 (0 ms) 2024-09-16T07:38:45.367 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAioEC.RoundTripPP3 2024-09-16T07:38:45.367 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:1500: Skipped 2024-09-16T07:38:45.367 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:45.367 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP3 (0 ms) 2024-09-16T07:38:45.368 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAioEC.RoundTripSparseReadPP 2024-09-16T07:38:45.368 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:1605: Skipped 2024-09-16T07:38:45.368 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:45.368 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripSparseReadPP (0 ms) 2024-09-16T07:38:45.368 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAioEC.RoundTripAppendPP 2024-09-16T07:38:45.368 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:1637: Skipped 2024-09-16T07:38:45.368 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:45.368 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripAppendPP (0 ms) 2024-09-16T07:38:45.368 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAioEC.IsCompletePP 2024-09-16T07:38:45.368 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:1705: Skipped 2024-09-16T07:38:45.368 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:45.368 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosAioEC.IsCompletePP (0 ms) 2024-09-16T07:38:45.369 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAioEC.IsSafePP 2024-09-16T07:38:45.369 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:1742: Skipped 2024-09-16T07:38:45.369 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:45.369 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosAioEC.IsSafePP (0 ms) 2024-09-16T07:38:45.369 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAioEC.ReturnValuePP 2024-09-16T07:38:45.369 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:1780: Skipped 2024-09-16T07:38:45.369 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:45.369 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosAioEC.ReturnValuePP (0 ms) 2024-09-16T07:38:45.369 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAioEC.FlushPP 2024-09-16T07:38:45.369 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:1796: Skipped 2024-09-16T07:38:45.369 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:45.369 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosAioEC.FlushPP (0 ms) 2024-09-16T07:38:45.370 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAioEC.FlushAsyncPP 2024-09-16T07:38:45.370 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:1824: Skipped 2024-09-16T07:38:45.370 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:45.370 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosAioEC.FlushAsyncPP (0 ms) 2024-09-16T07:38:45.370 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAioEC.RoundTripWriteFullPP 2024-09-16T07:38:45.370 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:1859: Skipped 2024-09-16T07:38:45.370 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:45.370 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFullPP (1 ms) 2024-09-16T07:38:45.370 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAioEC.RoundTripWriteFullPP2 2024-09-16T07:38:45.370 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:1904: Skipped 2024-09-16T07:38:45.370 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:45.370 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFullPP2 (0 ms) 2024-09-16T07:38:45.370 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAioEC.SimpleStatPP 2024-09-16T07:38:45.370 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:1946: Skipped 2024-09-16T07:38:45.371 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:45.371 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatPP (0 ms) 2024-09-16T07:38:45.371 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAioEC.SimpleStatPPNS 2024-09-16T07:38:45.371 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:1977: Skipped 2024-09-16T07:38:45.371 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:45.371 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatPPNS (0 ms) 2024-09-16T07:38:45.371 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAioEC.StatRemovePP 2024-09-16T07:38:45.371 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:2008: Skipped 2024-09-16T07:38:45.371 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:45.371 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosAioEC.StatRemovePP (0 ms) 2024-09-16T07:38:45.371 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAioEC.ExecuteClassPP 2024-09-16T07:38:45.371 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:2059: Skipped 2024-09-16T07:38:45.371 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:45.371 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosAioEC.ExecuteClassPP (0 ms) 2024-09-16T07:38:45.372 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAioEC.OmapPP 2024-09-16T07:38:45.372 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:2089: Skipped 2024-09-16T07:38:45.372 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:45.372 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosAioEC.OmapPP (0 ms) 2024-09-16T07:38:45.372 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosAioEC.MultiWritePP 2024-09-16T07:38:45.372 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/aio_cxx.cc:2124: Skipped 2024-09-16T07:38:45.372 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:45.372 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosAioEC.MultiWritePP (0 ms) 2024-09-16T07:38:45.372 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 20 tests from LibRadosAioEC (1 ms total) 2024-09-16T07:38:45.372 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:38:45.372 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment tear-down 2024-09-16T07:38:45.372 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] 57 tests from 4 test suites ran. (157044 ms total) 2024-09-16T07:38:45.372 INFO:tasks.workunit.client.0.smithi121.stdout:[ PASSED ] 36 tests. 2024-09-16T07:38:45.373 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] 21 tests, listed below: 2024-09-16T07:38:45.373 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosAio.MultiReads 2024-09-16T07:38:45.373 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosAioEC.SimpleWritePP 2024-09-16T07:38:45.373 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosAioEC.WaitForSafePP 2024-09-16T07:38:45.373 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP 2024-09-16T07:38:45.373 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP2 2024-09-16T07:38:45.373 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP3 2024-09-16T07:38:45.373 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripSparseReadPP 2024-09-16T07:38:45.373 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripAppendPP 2024-09-16T07:38:45.373 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosAioEC.IsCompletePP 2024-09-16T07:38:45.373 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosAioEC.IsSafePP 2024-09-16T07:38:45.373 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosAioEC.ReturnValuePP 2024-09-16T07:38:45.373 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosAioEC.FlushPP 2024-09-16T07:38:45.374 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosAioEC.FlushAsyncPP 2024-09-16T07:38:45.374 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFullPP 2024-09-16T07:38:45.374 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFullPP2 2024-09-16T07:38:45.374 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatPP 2024-09-16T07:38:45.374 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatPPNS 2024-09-16T07:38:45.374 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosAioEC.StatRemovePP 2024-09-16T07:38:45.374 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosAioEC.ExecuteClassPP 2024-09-16T07:38:45.374 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosAioEC.OmapPP 2024-09-16T07:38:45.374 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosAioEC.MultiWritePP 2024-09-16T07:38:45.375 INFO:tasks.workunit.client.0.smithi121.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T07:38:45.375 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T07:38:45.375 INFO:tasks.workunit.client.0.smithi121.stderr:+ ceph_test_rados_api_io 2024-09-16T07:38:45.388 INFO:tasks.workunit.client.0.smithi121.stdout:Running main() from gmock_main.cc 2024-09-16T07:38:45.388 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] Running 24 tests from 2 test suites. 2024-09-16T07:38:45.388 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment set-up. 2024-09-16T07:38:45.388 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 14 tests from LibRadosIo 2024-09-16T07:38:47.325 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosIo.SimpleWrite 2024-09-16T07:38:47.624 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosIo.SimpleWrite (298 ms) 2024-09-16T07:38:47.624 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosIo.TooBig 2024-09-16T07:38:47.624 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosIo.TooBig (0 ms) 2024-09-16T07:38:47.624 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosIo.ReadTimeout 2024-09-16T07:38:47.691 INFO:tasks.workunit.client.0.smithi121.stdout:no timeout :/ 2024-09-16T07:38:47.692 INFO:tasks.workunit.client.0.smithi121.stdout:no timeout :/ 2024-09-16T07:38:47.692 INFO:tasks.workunit.client.0.smithi121.stdout:no timeout :/ 2024-09-16T07:38:47.692 INFO:tasks.workunit.client.0.smithi121.stdout:no timeout :/ 2024-09-16T07:38:47.692 INFO:tasks.workunit.client.0.smithi121.stdout:no timeout :/ 2024-09-16T07:38:47.692 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosIo.ReadTimeout (68 ms) 2024-09-16T07:38:47.692 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosIo.RoundTrip 2024-09-16T07:38:47.730 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosIo.RoundTrip (39 ms) 2024-09-16T07:38:47.730 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosIo.Checksum 2024-09-16T07:38:47.749 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosIo.Checksum (19 ms) 2024-09-16T07:38:47.749 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosIo.OverlappingWriteRoundTrip 2024-09-16T07:38:47.779 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosIo.OverlappingWriteRoundTrip (30 ms) 2024-09-16T07:38:47.779 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosIo.WriteFullRoundTrip 2024-09-16T07:38:47.815 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosIo.WriteFullRoundTrip (36 ms) 2024-09-16T07:38:47.815 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosIo.AppendRoundTrip 2024-09-16T07:38:47.850 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosIo.AppendRoundTrip (34 ms) 2024-09-16T07:38:47.850 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosIo.ZeroLenZero 2024-09-16T07:38:47.855 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosIo.ZeroLenZero (5 ms) 2024-09-16T07:38:47.855 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosIo.TruncTest 2024-09-16T07:38:47.887 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosIo.TruncTest (31 ms) 2024-09-16T07:38:47.887 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosIo.RemoveTest 2024-09-16T07:38:47.915 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosIo.RemoveTest (29 ms) 2024-09-16T07:38:47.916 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosIo.XattrsRoundTrip 2024-09-16T07:38:47.951 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosIo.XattrsRoundTrip (36 ms) 2024-09-16T07:38:47.952 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosIo.RmXattr 2024-09-16T07:38:48.039 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosIo.RmXattr (88 ms) 2024-09-16T07:38:48.040 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosIo.XattrIter 2024-09-16T07:38:48.081 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosIo.XattrIter (42 ms) 2024-09-16T07:38:48.381 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 14 tests from LibRadosIo (756 ms total) 2024-09-16T07:38:48.382 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:38:48.382 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 10 tests from LibRadosIoEC 2024-09-16T07:38:48.382 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:168: Skipped 2024-09-16T07:38:48.382 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:48.382 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosIoEC.SimpleWrite 2024-09-16T07:38:48.382 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T07:38:48.382 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:48.382 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T07:38:48.382 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:48.382 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosIoEC.SimpleWrite (0 ms) 2024-09-16T07:38:48.382 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosIoEC.RoundTrip 2024-09-16T07:38:48.383 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T07:38:48.383 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:48.383 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T07:38:48.383 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:48.383 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosIoEC.RoundTrip (0 ms) 2024-09-16T07:38:48.383 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosIoEC.OverlappingWriteRoundTrip 2024-09-16T07:38:48.383 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T07:38:48.383 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:48.383 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T07:38:48.383 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:48.383 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosIoEC.OverlappingWriteRoundTrip (0 ms) 2024-09-16T07:38:48.383 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosIoEC.WriteFullRoundTrip 2024-09-16T07:38:48.383 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T07:38:48.384 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:48.384 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T07:38:48.384 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:48.384 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosIoEC.WriteFullRoundTrip (0 ms) 2024-09-16T07:38:48.384 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosIoEC.AppendRoundTrip 2024-09-16T07:38:48.384 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T07:38:48.384 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:48.384 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T07:38:48.384 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:48.384 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosIoEC.AppendRoundTrip (0 ms) 2024-09-16T07:38:48.384 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosIoEC.TruncTest 2024-09-16T07:38:48.384 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T07:38:48.384 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:48.385 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T07:38:48.385 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:48.385 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosIoEC.TruncTest (0 ms) 2024-09-16T07:38:48.385 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosIoEC.RemoveTest 2024-09-16T07:38:48.385 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T07:38:48.385 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:48.385 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T07:38:48.385 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:48.385 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosIoEC.RemoveTest (0 ms) 2024-09-16T07:38:48.385 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosIoEC.XattrsRoundTrip 2024-09-16T07:38:48.385 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T07:38:48.385 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:48.385 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T07:38:48.386 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:48.386 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosIoEC.XattrsRoundTrip (0 ms) 2024-09-16T07:38:48.386 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosIoEC.RmXattr 2024-09-16T07:38:48.386 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T07:38:48.386 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:48.386 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T07:38:48.386 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:48.386 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosIoEC.RmXattr (0 ms) 2024-09-16T07:38:48.386 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosIoEC.XattrIter 2024-09-16T07:38:48.386 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T07:38:48.386 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:48.386 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T07:38:48.386 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:48.386 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosIoEC.XattrIter (0 ms) 2024-09-16T07:38:48.386 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:176: Skipped 2024-09-16T07:38:48.387 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:48.387 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 10 tests from LibRadosIoEC (0 ms total) 2024-09-16T07:38:48.387 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:38:48.387 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment tear-down 2024-09-16T07:38:48.387 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] 24 tests from 2 test suites ran. (2993 ms total) 2024-09-16T07:38:48.387 INFO:tasks.workunit.client.0.smithi121.stdout:[ PASSED ] 14 tests. 2024-09-16T07:38:48.387 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] 10 tests, listed below: 2024-09-16T07:38:48.387 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosIoEC.SimpleWrite 2024-09-16T07:38:48.387 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosIoEC.RoundTrip 2024-09-16T07:38:48.387 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosIoEC.OverlappingWriteRoundTrip 2024-09-16T07:38:48.387 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosIoEC.WriteFullRoundTrip 2024-09-16T07:38:48.387 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosIoEC.AppendRoundTrip 2024-09-16T07:38:48.387 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosIoEC.TruncTest 2024-09-16T07:38:48.388 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosIoEC.RemoveTest 2024-09-16T07:38:48.388 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosIoEC.XattrsRoundTrip 2024-09-16T07:38:48.388 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosIoEC.RmXattr 2024-09-16T07:38:48.388 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosIoEC.XattrIter 2024-09-16T07:38:48.388 INFO:tasks.workunit.client.0.smithi121.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T07:38:48.388 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T07:38:48.388 INFO:tasks.workunit.client.0.smithi121.stderr:+ ceph_test_rados_api_io_pp 2024-09-16T07:38:48.404 INFO:tasks.workunit.client.0.smithi121.stdout:Running main() from gmock_main.cc 2024-09-16T07:38:48.404 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] Running 40 tests from 2 test suites. 2024-09-16T07:38:48.404 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment set-up. 2024-09-16T07:38:48.404 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 22 tests from LibRadosIoPP 2024-09-16T07:38:48.404 INFO:tasks.workunit.client.0.smithi121.stdout:seed 31175 2024-09-16T07:38:50.390 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosIoPP.TooBigPP 2024-09-16T07:38:50.390 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosIoPP.TooBigPP (0 ms) 2024-09-16T07:38:50.390 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosIoPP.SimpleWritePP 2024-09-16T07:38:50.637 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosIoPP.SimpleWritePP (246 ms) 2024-09-16T07:38:50.637 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosIoPP.ReadOpPP 2024-09-16T07:38:50.720 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosIoPP.ReadOpPP (82 ms) 2024-09-16T07:38:50.720 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosIoPP.SparseReadOpPP 2024-09-16T07:38:50.749 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosIoPP.SparseReadOpPP (30 ms) 2024-09-16T07:38:50.749 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosIoPP.SparseReadExtentArrayOpPP 2024-09-16T07:38:53.575 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosIoPP.SparseReadExtentArrayOpPP (2826 ms) 2024-09-16T07:38:53.575 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosIoPP.RoundTripPP 2024-09-16T07:38:53.599 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosIoPP.RoundTripPP (24 ms) 2024-09-16T07:38:53.599 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosIoPP.RoundTripPP2 2024-09-16T07:38:53.620 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosIoPP.RoundTripPP2 (21 ms) 2024-09-16T07:38:53.620 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosIoPP.Checksum 2024-09-16T07:38:53.640 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosIoPP.Checksum (20 ms) 2024-09-16T07:38:53.640 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosIoPP.ReadIntoBufferlist 2024-09-16T07:38:53.659 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosIoPP.ReadIntoBufferlist (18 ms) 2024-09-16T07:38:53.659 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosIoPP.OverlappingWriteRoundTripPP 2024-09-16T07:38:53.690 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosIoPP.OverlappingWriteRoundTripPP (32 ms) 2024-09-16T07:38:53.690 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosIoPP.WriteFullRoundTripPP 2024-09-16T07:38:53.720 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosIoPP.WriteFullRoundTripPP (30 ms) 2024-09-16T07:38:53.720 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosIoPP.WriteFullRoundTripPP2 2024-09-16T07:38:53.739 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosIoPP.WriteFullRoundTripPP2 (19 ms) 2024-09-16T07:38:53.740 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosIoPP.AppendRoundTripPP 2024-09-16T07:38:53.773 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosIoPP.AppendRoundTripPP (34 ms) 2024-09-16T07:38:53.774 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosIoPP.TruncTestPP 2024-09-16T07:38:53.805 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosIoPP.TruncTestPP (32 ms) 2024-09-16T07:38:53.805 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosIoPP.RemoveTestPP 2024-09-16T07:38:53.835 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosIoPP.RemoveTestPP (30 ms) 2024-09-16T07:38:53.835 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosIoPP.XattrsRoundTripPP 2024-09-16T07:38:53.871 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosIoPP.XattrsRoundTripPP (36 ms) 2024-09-16T07:38:53.871 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosIoPP.RmXattrPP 2024-09-16T07:38:53.956 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosIoPP.RmXattrPP (85 ms) 2024-09-16T07:38:53.956 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosIoPP.XattrListPP 2024-09-16T07:38:53.997 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosIoPP.XattrListPP (41 ms) 2024-09-16T07:38:53.997 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosIoPP.CrcZeroWrite 2024-09-16T07:38:54.029 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosIoPP.CrcZeroWrite (31 ms) 2024-09-16T07:38:54.029 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosIoPP.CmpExtPP 2024-09-16T07:38:54.061 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosIoPP.CmpExtPP (33 ms) 2024-09-16T07:38:54.061 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosIoPP.CmpExtDNEPP 2024-09-16T07:38:54.080 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosIoPP.CmpExtDNEPP (18 ms) 2024-09-16T07:38:54.080 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosIoPP.CmpExtMismatchPP 2024-09-16T07:38:54.106 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosIoPP.CmpExtMismatchPP (27 ms) 2024-09-16T07:38:54.403 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 22 tests from LibRadosIoPP (3716 ms total) 2024-09-16T07:38:54.404 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:38:54.404 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 18 tests from LibRadosIoECPP 2024-09-16T07:38:54.404 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:375: Skipped 2024-09-16T07:38:54.404 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:54.404 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosIoECPP.SimpleWritePP 2024-09-16T07:38:54.404 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T07:38:54.404 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:54.404 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T07:38:54.404 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:54.404 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosIoECPP.SimpleWritePP (0 ms) 2024-09-16T07:38:54.404 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosIoECPP.ReadOpPP 2024-09-16T07:38:54.405 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T07:38:54.405 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:54.405 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T07:38:54.405 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:54.405 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosIoECPP.ReadOpPP (0 ms) 2024-09-16T07:38:54.405 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosIoECPP.SparseReadOpPP 2024-09-16T07:38:54.405 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T07:38:54.405 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:54.405 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T07:38:54.405 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:54.406 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosIoECPP.SparseReadOpPP (0 ms) 2024-09-16T07:38:54.406 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosIoECPP.RoundTripPP 2024-09-16T07:38:54.406 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T07:38:54.406 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:54.406 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T07:38:54.406 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:54.406 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosIoECPP.RoundTripPP (0 ms) 2024-09-16T07:38:54.406 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosIoECPP.RoundTripPP2 2024-09-16T07:38:54.406 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T07:38:54.406 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:54.406 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T07:38:54.406 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:54.406 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosIoECPP.RoundTripPP2 (0 ms) 2024-09-16T07:38:54.407 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosIoECPP.OverlappingWriteRoundTripPP 2024-09-16T07:38:54.407 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T07:38:54.407 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:54.407 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T07:38:54.407 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:54.407 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosIoECPP.OverlappingWriteRoundTripPP (0 ms) 2024-09-16T07:38:54.407 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosIoECPP.WriteFullRoundTripPP 2024-09-16T07:38:54.407 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T07:38:54.407 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:54.407 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T07:38:54.407 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:54.407 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosIoECPP.WriteFullRoundTripPP (0 ms) 2024-09-16T07:38:54.407 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosIoECPP.WriteFullRoundTripPP2 2024-09-16T07:38:54.408 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T07:38:54.408 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:54.408 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T07:38:54.408 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:54.408 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosIoECPP.WriteFullRoundTripPP2 (0 ms) 2024-09-16T07:38:54.408 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosIoECPP.AppendRoundTripPP 2024-09-16T07:38:54.408 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T07:38:54.408 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:54.408 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T07:38:54.408 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:54.408 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosIoECPP.AppendRoundTripPP (0 ms) 2024-09-16T07:38:54.408 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosIoECPP.TruncTestPP 2024-09-16T07:38:54.408 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T07:38:54.408 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:54.409 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T07:38:54.409 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:54.409 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosIoECPP.TruncTestPP (0 ms) 2024-09-16T07:38:54.409 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosIoECPP.RemoveTestPP 2024-09-16T07:38:54.409 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T07:38:54.409 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:54.409 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T07:38:54.409 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:54.409 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosIoECPP.RemoveTestPP (0 ms) 2024-09-16T07:38:54.409 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosIoECPP.XattrsRoundTripPP 2024-09-16T07:38:54.409 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T07:38:54.409 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:54.409 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T07:38:54.409 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:54.410 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosIoECPP.XattrsRoundTripPP (0 ms) 2024-09-16T07:38:54.410 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosIoECPP.RmXattrPP 2024-09-16T07:38:54.410 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T07:38:54.410 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:54.410 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T07:38:54.410 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:54.410 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosIoECPP.RmXattrPP (0 ms) 2024-09-16T07:38:54.411 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosIoECPP.CrcZeroWrite 2024-09-16T07:38:54.411 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T07:38:54.411 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:54.411 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T07:38:54.411 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:54.411 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosIoECPP.CrcZeroWrite (0 ms) 2024-09-16T07:38:54.412 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosIoECPP.XattrListPP 2024-09-16T07:38:54.412 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T07:38:54.412 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:54.412 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T07:38:54.413 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:54.413 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosIoECPP.XattrListPP (0 ms) 2024-09-16T07:38:54.413 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosIoECPP.CmpExtPP 2024-09-16T07:38:54.413 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T07:38:54.413 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:54.414 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T07:38:54.414 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:54.414 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtPP (0 ms) 2024-09-16T07:38:54.414 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosIoECPP.CmpExtDNEPP 2024-09-16T07:38:54.414 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T07:38:54.414 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:54.415 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T07:38:54.415 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:54.415 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtDNEPP (0 ms) 2024-09-16T07:38:54.415 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosIoECPP.CmpExtMismatchPP 2024-09-16T07:38:54.415 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T07:38:54.416 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:54.416 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T07:38:54.416 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:54.416 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtMismatchPP (0 ms) 2024-09-16T07:38:54.416 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:383: Skipped 2024-09-16T07:38:54.416 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:38:54.416 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 18 tests from LibRadosIoECPP (0 ms total) 2024-09-16T07:38:54.416 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:38:54.416 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment tear-down 2024-09-16T07:38:54.416 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] 40 tests from 2 test suites ran. (5996 ms total) 2024-09-16T07:38:54.416 INFO:tasks.workunit.client.0.smithi121.stdout:[ PASSED ] 22 tests. 2024-09-16T07:38:54.416 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] 18 tests, listed below: 2024-09-16T07:38:54.417 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosIoECPP.SimpleWritePP 2024-09-16T07:38:54.417 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosIoECPP.ReadOpPP 2024-09-16T07:38:54.417 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosIoECPP.SparseReadOpPP 2024-09-16T07:38:54.417 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosIoECPP.RoundTripPP 2024-09-16T07:38:54.417 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosIoECPP.RoundTripPP2 2024-09-16T07:38:54.417 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosIoECPP.OverlappingWriteRoundTripPP 2024-09-16T07:38:54.417 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosIoECPP.WriteFullRoundTripPP 2024-09-16T07:38:54.417 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosIoECPP.WriteFullRoundTripPP2 2024-09-16T07:38:54.417 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosIoECPP.AppendRoundTripPP 2024-09-16T07:38:54.417 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosIoECPP.TruncTestPP 2024-09-16T07:38:54.417 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosIoECPP.RemoveTestPP 2024-09-16T07:38:54.417 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosIoECPP.XattrsRoundTripPP 2024-09-16T07:38:54.417 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosIoECPP.RmXattrPP 2024-09-16T07:38:54.417 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosIoECPP.CrcZeroWrite 2024-09-16T07:38:54.418 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosIoECPP.XattrListPP 2024-09-16T07:38:54.418 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtPP 2024-09-16T07:38:54.418 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtDNEPP 2024-09-16T07:38:54.418 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtMismatchPP 2024-09-16T07:38:54.418 INFO:tasks.workunit.client.0.smithi121.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T07:38:54.418 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T07:38:54.418 INFO:tasks.workunit.client.0.smithi121.stderr:+ ceph_test_rados_api_asio 2024-09-16T07:38:54.434 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:54.434+0000 7f2b7e5226c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:38:54.467 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:54.466+0000 7f2b7e5226c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:38:54.467 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:54.467+0000 7f2b7e5226c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:38:54.467 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] Running 12 tests from 1 test suite. 2024-09-16T07:38:54.468 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment set-up. 2024-09-16T07:38:54.468 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 12 tests from AsioRados 2024-09-16T07:38:54.469 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:54.469+0000 7f2b7e5226c0 1 Processor -- start 2024-09-16T07:38:54.469 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:54.469+0000 7f2b7e5226c0 1 -- start start 2024-09-16T07:38:54.472 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:54.471+0000 7f2b7e5226c0 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xc45b00 0xd66560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:38:54.472 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:54.471+0000 7f2b7e5226c0 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0xbad520 con 0xc45b00 2024-09-16T07:38:54.473 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:54.472+0000 7f2b737fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xc45b00 0xd66560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:38:54.473 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:54.472+0000 7f2b737fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xc45b00 0xd66560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38864/0 (socket says 172.21.15.121:38864) 2024-09-16T07:38:54.473 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:54.472+0000 7f2b737fe640 1 -- 172.21.15.121:0/1794209867 learned_addr learned my addr 172.21.15.121:0/1794209867 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:38:54.473 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:54.473+0000 7f2b737fe640 1 -- 172.21.15.121:0/1794209867 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xb49e10 con 0xc45b00 2024-09-16T07:38:54.473 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:54.473+0000 7f2b737fe640 1 --2- 172.21.15.121:0/1794209867 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xc45b00 0xd66560 crc :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb86f3e0c3d16f96 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:38:54.474 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:54.474+0000 7f2b71ffb640 1 -- 172.21.15.121:0/1794209867 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2b64009690 con 0xc45b00 2024-09-16T07:38:54.474 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:54.474+0000 7f2b71ffb640 1 -- 172.21.15.121:0/1794209867 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f2b64001430 con 0xc45b00 2024-09-16T07:38:54.474 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:54.474+0000 7f2b71ffb640 1 -- 172.21.15.121:0/1794209867 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2b640074f0 con 0xc45b00 2024-09-16T07:38:54.475 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:54.475+0000 7f2b7e5226c0 1 -- 172.21.15.121:0/1794209867 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xc45b00 msgr2=0xd66560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:38:54.475 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:54.475+0000 7f2b7e5226c0 1 --2- 172.21.15.121:0/1794209867 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xc45b00 0xd66560 crc :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:38:54.477 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:54.476+0000 7f2b7e5226c0 1 -- 172.21.15.121:0/1794209867 shutdown_connections 2024-09-16T07:38:54.477 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:54.476+0000 7f2b7e5226c0 1 --2- 172.21.15.121:0/1794209867 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xc45b00 0xd66560 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:38:54.477 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:54.476+0000 7f2b7e5226c0 1 -- 172.21.15.121:0/1794209867 >> 172.21.15.121:0/1794209867 conn(0xb6d770 msgr2=0xc434c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:38:54.477 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:54.477+0000 7f2b7e5226c0 1 -- 172.21.15.121:0/1794209867 shutdown_connections 2024-09-16T07:38:54.477 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:54.477+0000 7f2b7e5226c0 1 -- 172.21.15.121:0/1794209867 wait complete. 2024-09-16T07:38:54.478 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:54.478+0000 7f2b7e5226c0 1 Processor -- start 2024-09-16T07:38:54.478 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:54.479+0000 7f2b7e5226c0 1 -- start start 2024-09-16T07:38:54.481 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:54.480+0000 7f2b7e5226c0 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xc45b00 0xd4e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:38:54.481 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:54.481+0000 7f2b7e5226c0 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0xbab280 con 0xc45b00 2024-09-16T07:38:54.481 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:54.481+0000 7f2b737fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xc45b00 0xd4e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:38:54.481 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:54.481+0000 7f2b737fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xc45b00 0xd4e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38874/0 (socket says 172.21.15.121:38874) 2024-09-16T07:38:54.481 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:54.481+0000 7f2b737fe640 1 -- 172.21.15.121:0/180366063 learned_addr learned my addr 172.21.15.121:0/180366063 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:38:54.482 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:54.481+0000 7f2b737fe640 1 -- 172.21.15.121:0/180366063 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xb3b920 con 0xc45b00 2024-09-16T07:38:54.482 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:54.481+0000 7f2b737fe640 1 --2- 172.21.15.121:0/180366063 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xc45b00 0xd4e2a0 crc :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:38:54.482 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:54.482+0000 7f2b70ff9640 1 -- 172.21.15.121:0/180366063 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2b64007c50 con 0xc45b00 2024-09-16T07:38:54.483 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:54.482+0000 7f2b70ff9640 1 -- 172.21.15.121:0/180366063 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f2b64007db0 con 0xc45b00 2024-09-16T07:38:54.483 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:54.482+0000 7f2b70ff9640 1 -- 172.21.15.121:0/180366063 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2b64039580 con 0xc45b00 2024-09-16T07:38:54.483 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:54.482+0000 7f2b7e5226c0 1 -- 172.21.15.121:0/180366063 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0xb3b380 con 0xc45b00 2024-09-16T07:38:54.483 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:54.482+0000 7f2b7e5226c0 1 -- 172.21.15.121:0/180366063 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0xd508f0 con 0xc45b00 2024-09-16T07:38:54.485 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:54.483+0000 7f2b70ff9640 1 -- 172.21.15.121:0/180366063 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f2b64039730 con 0xc45b00 2024-09-16T07:38:54.485 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:54.484+0000 7f2b70ff9640 1 --2- 172.21.15.121:0/180366063 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f2b6003d210 0x7f2b6003f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:38:54.485 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:54.484+0000 7f2b70ff9640 1 -- 172.21.15.121:0/180366063 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(237..237 src has 1..237) ==== 2700+0+0 (crc 0 0 0) 0x7f2b64032040 con 0xc45b00 2024-09-16T07:38:54.485 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:54.484+0000 7f2b7e5226c0 1 -- 172.21.15.121:0/180366063 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0xba3df0 con 0xc45b00 2024-09-16T07:38:54.485 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:54.484+0000 7f2b72ffd640 1 --2- 172.21.15.121:0/180366063 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f2b6003d210 0x7f2b6003f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:38:54.486 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:54.485+0000 7f2b70ff9640 1 -- 172.21.15.121:0/180366063 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_get_version_reply(handle=1 version=237) ==== 24+0+0 (crc 0 0 0) 0x7f2b6403aec0 con 0xc45b00 2024-09-16T07:38:54.486 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:54.485+0000 7f2b7e5226c0 1 -- 172.21.15.121:0/180366063 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- pool_op(create pool 0 tid 1 name ceph_test_rados_api_asio v0) -- 0xbb6bf0 con 0xc45b00 2024-09-16T07:38:54.486 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:54.485+0000 7f2b72ffd640 1 --2- 172.21.15.121:0/180366063 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f2b6003d210 0x7f2b6003f720 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:38:55.405 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:55.404+0000 7f2b70ff9640 1 -- 172.21.15.121:0/180366063 <== mon.0 v2:172.21.15.121:3300/0 7 ==== pool_op_reply(tid 1 (0) Success v238) ==== 43+0+0 (crc 0 0 0) 0x7f2b64038af0 con 0xc45b00 2024-09-16T07:38:55.405 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:55.404+0000 7f2b70ff9640 1 -- 172.21.15.121:0/180366063 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=238}) -- 0x7f2b60041b90 con 0xc45b00 2024-09-16T07:38:55.405 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:55.405+0000 7f2b70ff9640 1 -- 172.21.15.121:0/180366063 <== mon.0 v2:172.21.15.121:3300/0 8 ==== osd_map(238..238 src has 1..238) ==== 651+0+0 (crc 0 0 0) 0x7f2b64034b30 con 0xc45b00 2024-09-16T07:38:55.405 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:55.405+0000 7f2b7e5226c0 1 --2- 172.21.15.121:0/180366063 >> v2:172.21.15.121:6801/4208564222 conn(0xc45f10 0xd75d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:38:55.406 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:55.405+0000 7f2b7e5226c0 1 -- 172.21.15.121:0/180366063 --> v2:172.21.15.121:6801/4208564222 -- osd_op(unknown.0.0:2 75.1 75:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e238) -- 0xd762c0 con 0xc45f10 2024-09-16T07:38:55.411 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:55.411+0000 7f2b73fff640 1 --2- 172.21.15.121:0/180366063 >> v2:172.21.15.121:6801/4208564222 conn(0xc45f10 0xd75d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T07:38:55.420 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:55.420+0000 7f2b73fff640 1 --2- 172.21.15.121:0/180366063 >> v2:172.21.15.121:6801/4208564222 conn(0xc45f10 0xd75d80 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:38:56.605 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:56.604+0000 7f2b73fff640 1 -- 172.21.15.121:0/180366063 <== osd.1 v2:172.21.15.121:6801/4208564222 1 ==== osd_op_reply(2 exist [writefull 0~5] v239'1 uv1 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2b6c00a430 con 0xc45f10 2024-09-16T07:38:56.605 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] AsioRados.AsyncReadCallback 2024-09-16T07:38:56.605 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:56.605+0000 7f2b7e5226c0 1 -- 172.21.15.121:0/180366063 --> v2:172.21.15.121:6801/4208564222 -- osd_op(unknown.0.0:3 75.1 75:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e238) -- 0xd70a40 con 0xc45f10 2024-09-16T07:38:56.606 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:56.605+0000 7f2b7e5226c0 1 -- 172.21.15.121:0/180366063 --> v2:172.21.15.121:6801/4208564222 -- osd_op(unknown.0.0:4 75.1 75:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e238) -- 0xd712e0 con 0xc45f10 2024-09-16T07:38:56.613 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:56.613+0000 7f2b73fff640 1 -- 172.21.15.121:0/180366063 <== osd.1 v2:172.21.15.121:6801/4208564222 2 ==== osd_op_reply(3 exist [read 0~5 out=5b] v239'1 uv1 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7f2b6c00a430 con 0xc45f10 2024-09-16T07:38:56.615 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:56.615+0000 7f2b73fff640 1 -- 172.21.15.121:0/180366063 <== osd.1 v2:172.21.15.121:6801/4208564222 3 ==== osd_op_reply(4 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2b6c00a430 con 0xc45f10 2024-09-16T07:38:56.615 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] AsioRados.AsyncReadCallback (11 ms) 2024-09-16T07:38:56.615 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] AsioRados.AsyncReadFuture 2024-09-16T07:38:56.616 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:56.615+0000 7f2b7e5226c0 1 -- 172.21.15.121:0/180366063 --> v2:172.21.15.121:6801/4208564222 -- osd_op(unknown.0.0:5 75.1 75:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e238) -- 0xd716c0 con 0xc45f10 2024-09-16T07:38:56.616 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:56.615+0000 7f2b7e5226c0 1 -- 172.21.15.121:0/180366063 --> v2:172.21.15.121:6801/4208564222 -- osd_op(unknown.0.0:6 75.1 75:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e238) -- 0xd76620 con 0xc45f10 2024-09-16T07:38:56.630 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:56.630+0000 7f2b73fff640 1 -- 172.21.15.121:0/180366063 <== osd.1 v2:172.21.15.121:6801/4208564222 4 ==== osd_op_reply(5 exist [read 0~5 out=5b] v239'1 uv1 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7f2b6c00a430 con 0xc45f10 2024-09-16T07:38:56.630 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:56.630+0000 7f2b73fff640 1 -- 172.21.15.121:0/180366063 <== osd.1 v2:172.21.15.121:6801/4208564222 5 ==== osd_op_reply(6 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2b6c00a430 con 0xc45f10 2024-09-16T07:38:56.630 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] AsioRados.AsyncReadFuture (15 ms) 2024-09-16T07:38:56.631 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] AsioRados.AsyncReadYield 2024-09-16T07:38:56.631 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:56.630+0000 7f2b7e5226c0 1 -- 172.21.15.121:0/180366063 --> v2:172.21.15.121:6801/4208564222 -- osd_op(unknown.0.0:7 75.1 75:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e238) -- 0xd70e10 con 0xc45f10 2024-09-16T07:38:56.631 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:56.630+0000 7f2b7e5226c0 1 -- 172.21.15.121:0/180366063 --> v2:172.21.15.121:6801/4208564222 -- osd_op(unknown.0.0:8 75.1 75:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e238) -- 0xdb6e50 con 0xc45f10 2024-09-16T07:38:56.640 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:56.640+0000 7f2b73fff640 1 -- 172.21.15.121:0/180366063 <== osd.1 v2:172.21.15.121:6801/4208564222 6 ==== osd_op_reply(8 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2b6c00a430 con 0xc45f10 2024-09-16T07:38:56.641 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:56.640+0000 7f2b73fff640 1 -- 172.21.15.121:0/180366063 <== osd.1 v2:172.21.15.121:6801/4208564222 7 ==== osd_op_reply(7 exist [read 0~5 out=5b] v239'1 uv1 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7f2b6c00a430 con 0xc45f10 2024-09-16T07:38:56.641 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] AsioRados.AsyncReadYield (10 ms) 2024-09-16T07:38:56.641 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] AsioRados.AsyncWriteCallback 2024-09-16T07:38:56.641 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:56.640+0000 7f2b7e5226c0 1 -- 172.21.15.121:0/180366063 --> v2:172.21.15.121:6801/4208564222 -- osd_op(unknown.0.0:9 75.1 75:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e238) -- 0xd694f0 con 0xc45f10 2024-09-16T07:38:56.656 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:56.656+0000 7f2b73fff640 1 -- 172.21.15.121:0/180366063 <== osd.1 v2:172.21.15.121:6801/4208564222 8 ==== osd_op_reply(9 exist [write 0~5] v239'2 uv2 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2b6c00a430 con 0xc45f10 2024-09-16T07:38:56.656 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] AsioRados.AsyncWriteCallback (16 ms) 2024-09-16T07:38:56.656 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] AsioRados.AsyncWriteFuture 2024-09-16T07:38:56.657 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:56.656+0000 7f2b7e5226c0 1 -- 172.21.15.121:0/180366063 --> v2:172.21.15.121:6801/4208564222 -- osd_op(unknown.0.0:10 75.1 75:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e238) -- 0xd694f0 con 0xc45f10 2024-09-16T07:38:56.673 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:56.673+0000 7f2b73fff640 1 -- 172.21.15.121:0/180366063 <== osd.1 v2:172.21.15.121:6801/4208564222 9 ==== osd_op_reply(10 exist [write 0~5] v239'3 uv3 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2b6c00a430 con 0xc45f10 2024-09-16T07:38:56.674 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] AsioRados.AsyncWriteFuture (17 ms) 2024-09-16T07:38:56.674 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] AsioRados.AsyncWriteYield 2024-09-16T07:38:56.674 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:56.673+0000 7f2b7e5226c0 1 -- 172.21.15.121:0/180366063 --> v2:172.21.15.121:6801/4208564222 -- osd_op(unknown.0.0:11 75.1 75:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e238) -- 0xd99df0 con 0xc45f10 2024-09-16T07:38:56.689 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:56.689+0000 7f2b73fff640 1 -- 172.21.15.121:0/180366063 <== osd.1 v2:172.21.15.121:6801/4208564222 10 ==== osd_op_reply(11 exist [write 0~5] v239'4 uv4 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2b6c00a430 con 0xc45f10 2024-09-16T07:38:56.690 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] AsioRados.AsyncWriteYield (16 ms) 2024-09-16T07:38:56.690 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] AsioRados.AsyncReadOperationCallback 2024-09-16T07:38:56.690 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:56.689+0000 7f2b7e5226c0 1 -- 172.21.15.121:0/180366063 --> v2:172.21.15.121:6801/4208564222 -- osd_op(unknown.0.0:12 75.1 75:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e238) -- 0xd76e30 con 0xc45f10 2024-09-16T07:38:56.690 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:56.689+0000 7f2b7e5226c0 1 -- 172.21.15.121:0/180366063 --> v2:172.21.15.121:6801/4208564222 -- osd_op(unknown.0.0:13 75.1 75:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e238) -- 0xd77820 con 0xc45f10 2024-09-16T07:38:56.700 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:56.700+0000 7f2b73fff640 1 -- 172.21.15.121:0/180366063 <== osd.1 v2:172.21.15.121:6801/4208564222 11 ==== osd_op_reply(13 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2b6c00a430 con 0xc45f10 2024-09-16T07:38:56.700 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:56.700+0000 7f2b73fff640 1 -- 172.21.15.121:0/180366063 <== osd.1 v2:172.21.15.121:6801/4208564222 12 ==== osd_op_reply(12 exist [read 0~5 out=5b] v239'4 uv4 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7f2b6c00a430 con 0xc45f10 2024-09-16T07:38:56.701 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] AsioRados.AsyncReadOperationCallback (11 ms) 2024-09-16T07:38:56.701 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] AsioRados.AsyncReadOperationFuture 2024-09-16T07:38:56.701 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:56.700+0000 7f2b7e5226c0 1 -- 172.21.15.121:0/180366063 --> v2:172.21.15.121:6801/4208564222 -- osd_op(unknown.0.0:14 75.1 75:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e238) -- 0xd76e30 con 0xc45f10 2024-09-16T07:38:56.701 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:56.700+0000 7f2b7e5226c0 1 -- 172.21.15.121:0/180366063 --> v2:172.21.15.121:6801/4208564222 -- osd_op(unknown.0.0:15 75.1 75:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e238) -- 0xd77820 con 0xc45f10 2024-09-16T07:38:56.711 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:56.710+0000 7f2b73fff640 1 -- 172.21.15.121:0/180366063 <== osd.1 v2:172.21.15.121:6801/4208564222 13 ==== osd_op_reply(15 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2b6c00a430 con 0xc45f10 2024-09-16T07:38:56.711 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:56.711+0000 7f2b73fff640 1 -- 172.21.15.121:0/180366063 <== osd.1 v2:172.21.15.121:6801/4208564222 14 ==== osd_op_reply(14 exist [read 0~5 out=5b] v239'4 uv4 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7f2b6c00a430 con 0xc45f10 2024-09-16T07:38:56.711 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] AsioRados.AsyncReadOperationFuture (11 ms) 2024-09-16T07:38:56.711 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] AsioRados.AsyncReadOperationYield 2024-09-16T07:38:56.711 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:56.711+0000 7f2b7e5226c0 1 -- 172.21.15.121:0/180366063 --> v2:172.21.15.121:6801/4208564222 -- osd_op(unknown.0.0:16 75.1 75:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e238) -- 0xd76e30 con 0xc45f10 2024-09-16T07:38:56.712 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:56.711+0000 7f2b7e5226c0 1 -- 172.21.15.121:0/180366063 --> v2:172.21.15.121:6801/4208564222 -- osd_op(unknown.0.0:17 75.1 75:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e238) -- 0xd9a3a0 con 0xc45f10 2024-09-16T07:38:56.720 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:56.720+0000 7f2b73fff640 1 -- 172.21.15.121:0/180366063 <== osd.1 v2:172.21.15.121:6801/4208564222 15 ==== osd_op_reply(17 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2b6c00a430 con 0xc45f10 2024-09-16T07:38:56.721 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:56.720+0000 7f2b73fff640 1 -- 172.21.15.121:0/180366063 <== osd.1 v2:172.21.15.121:6801/4208564222 16 ==== osd_op_reply(16 exist [read 0~5 out=5b] v239'4 uv4 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7f2b6c00a430 con 0xc45f10 2024-09-16T07:38:56.721 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] AsioRados.AsyncReadOperationYield (9 ms) 2024-09-16T07:38:56.721 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] AsioRados.AsyncWriteOperationCallback 2024-09-16T07:38:56.721 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:56.720+0000 7f2b7e5226c0 1 -- 172.21.15.121:0/180366063 --> v2:172.21.15.121:6801/4208564222 -- osd_op(unknown.0.0:18 75.1 75:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e238) -- 0xd9a3a0 con 0xc45f10 2024-09-16T07:38:56.735 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:56.734+0000 7f2b73fff640 1 -- 172.21.15.121:0/180366063 <== osd.1 v2:172.21.15.121:6801/4208564222 17 ==== osd_op_reply(18 exist [writefull 0~5] v239'5 uv5 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2b6c00a430 con 0xc45f10 2024-09-16T07:38:56.736 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] AsioRados.AsyncWriteOperationCallback (14 ms) 2024-09-16T07:38:56.736 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] AsioRados.AsyncWriteOperationFuture 2024-09-16T07:38:56.736 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:56.734+0000 7f2b7e5226c0 1 -- 172.21.15.121:0/180366063 --> v2:172.21.15.121:6801/4208564222 -- osd_op(unknown.0.0:19 75.1 75:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e238) -- 0xd9a3a0 con 0xc45f10 2024-09-16T07:38:56.745 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:56.745+0000 7f2b73fff640 1 -- 172.21.15.121:0/180366063 <== osd.1 v2:172.21.15.121:6801/4208564222 18 ==== osd_op_reply(19 exist [writefull 0~5] v239'6 uv6 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2b6c00a430 con 0xc45f10 2024-09-16T07:38:56.745 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] AsioRados.AsyncWriteOperationFuture (11 ms) 2024-09-16T07:38:56.746 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] AsioRados.AsyncWriteOperationYield 2024-09-16T07:38:56.746 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:56.745+0000 7f2b7e5226c0 1 -- 172.21.15.121:0/180366063 --> v2:172.21.15.121:6801/4208564222 -- osd_op(unknown.0.0:20 75.1 75:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e238) -- 0xd9a3a0 con 0xc45f10 2024-09-16T07:38:56.756 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:56.756+0000 7f2b73fff640 1 -- 172.21.15.121:0/180366063 <== osd.1 v2:172.21.15.121:6801/4208564222 19 ==== osd_op_reply(20 exist [writefull 0~5] v239'7 uv7 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f2b6c00a430 con 0xc45f10 2024-09-16T07:38:56.756 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] AsioRados.AsyncWriteOperationYield (11 ms) 2024-09-16T07:38:56.757 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:56.756+0000 7f2b7e5226c0 1 -- 172.21.15.121:0/180366063 >> v2:172.21.15.121:6801/4208564222 conn(0xc45f10 msgr2=0xd75d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:38:56.757 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:56.756+0000 7f2b7e5226c0 1 --2- 172.21.15.121:0/180366063 >> v2:172.21.15.121:6801/4208564222 conn(0xc45f10 0xd75d80 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:38:56.757 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:56.756+0000 7f2b7e5226c0 1 -- 172.21.15.121:0/180366063 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f2b6003d210 msgr2=0x7f2b6003f720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:38:56.757 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:56.756+0000 7f2b7e5226c0 1 --2- 172.21.15.121:0/180366063 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f2b6003d210 0x7f2b6003f720 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:38:56.758 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:56.756+0000 7f2b7e5226c0 1 -- 172.21.15.121:0/180366063 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xc45b00 msgr2=0xd4e2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:38:56.758 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:56.756+0000 7f2b7e5226c0 1 --2- 172.21.15.121:0/180366063 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xc45b00 0xd4e2a0 crc :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:38:56.758 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:56.756+0000 7f2b7e5226c0 1 -- 172.21.15.121:0/180366063 shutdown_connections 2024-09-16T07:38:56.758 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:56.756+0000 7f2b7e5226c0 1 --2- 172.21.15.121:0/180366063 >> v2:172.21.15.121:6801/4208564222 conn(0xc45f10 0xd75d80 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:38:56.758 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:56.756+0000 7f2b7e5226c0 1 --2- 172.21.15.121:0/180366063 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f2b6003d210 0x7f2b6003f720 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:38:56.758 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:56.756+0000 7f2b7e5226c0 1 --2- 172.21.15.121:0/180366063 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xc45b00 0xd4e2a0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:38:56.758 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:56.756+0000 7f2b7e5226c0 1 -- 172.21.15.121:0/180366063 >> 172.21.15.121:0/180366063 conn(0xb6d770 msgr2=0xd66540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:38:56.758 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:56.756+0000 7f2b7e5226c0 1 -- 172.21.15.121:0/180366063 shutdown_connections 2024-09-16T07:38:56.758 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:56.756+0000 7f2b7e5226c0 1 -- 172.21.15.121:0/180366063 wait complete. 2024-09-16T07:38:56.758 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 12 tests from AsioRados (152 ms total) 2024-09-16T07:38:56.759 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:38:56.759 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment tear-down 2024-09-16T07:38:56.759 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] 12 tests from 1 test suite ran. (2288 ms total) 2024-09-16T07:38:56.759 INFO:tasks.workunit.client.0.smithi121.stdout:[ PASSED ] 12 tests. 2024-09-16T07:38:56.759 INFO:tasks.workunit.client.0.smithi121.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T07:38:56.760 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T07:38:56.760 INFO:tasks.workunit.client.0.smithi121.stderr:+ ceph_test_rados_api_list 2024-09-16T07:38:56.789 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:56.788+0000 7f86bf5239c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:38:56.789 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:56.788+0000 7f86bf5239c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:38:56.789 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:38:56.789+0000 7f86bf5239c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:38:56.790 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] Running 11 tests from 3 test suites. 2024-09-16T07:38:56.790 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment set-up. 2024-09-16T07:38:56.790 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 7 tests from LibRadosList 2024-09-16T07:38:58.329 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosList.ListObjects 2024-09-16T07:38:58.870 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosList.ListObjects (541 ms) 2024-09-16T07:38:58.870 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosList.ListObjectsZeroInName 2024-09-16T07:38:59.089 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosList.ListObjectsZeroInName (219 ms) 2024-09-16T07:38:59.090 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosList.ListObjectsNS 2024-09-16T07:38:59.191 INFO:tasks.workunit.client.0.smithi121.stdout:myset foo1,foo2,foo3 2024-09-16T07:38:59.291 INFO:tasks.workunit.client.0.smithi121.stdout:foo1 2024-09-16T07:38:59.291 INFO:tasks.workunit.client.0.smithi121.stdout:foo2 2024-09-16T07:38:59.291 INFO:tasks.workunit.client.0.smithi121.stdout:foo3 2024-09-16T07:38:59.291 INFO:tasks.workunit.client.0.smithi121.stdout:myset foo1,foo4,foo5 2024-09-16T07:38:59.389 INFO:tasks.workunit.client.0.smithi121.stdout:foo4 2024-09-16T07:38:59.389 INFO:tasks.workunit.client.0.smithi121.stdout:foo5 2024-09-16T07:38:59.389 INFO:tasks.workunit.client.0.smithi121.stdout:foo1 2024-09-16T07:38:59.389 INFO:tasks.workunit.client.0.smithi121.stdout:myset foo6,foo7 2024-09-16T07:38:59.511 INFO:tasks.workunit.client.0.smithi121.stdout:foo7 2024-09-16T07:38:59.511 INFO:tasks.workunit.client.0.smithi121.stdout:foo6 2024-09-16T07:38:59.511 INFO:tasks.workunit.client.0.smithi121.stdout:myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2024-09-16T07:38:59.610 INFO:tasks.workunit.client.0.smithi121.stdout:ns1:foo4 2024-09-16T07:38:59.610 INFO:tasks.workunit.client.0.smithi121.stdout:ns1:foo5 2024-09-16T07:38:59.610 INFO:tasks.workunit.client.0.smithi121.stdout:ns2:foo7 2024-09-16T07:38:59.610 INFO:tasks.workunit.client.0.smithi121.stdout:ns2:foo6 2024-09-16T07:38:59.610 INFO:tasks.workunit.client.0.smithi121.stdout:ns1:foo1 2024-09-16T07:38:59.610 INFO:tasks.workunit.client.0.smithi121.stdout::foo1 2024-09-16T07:38:59.610 INFO:tasks.workunit.client.0.smithi121.stdout::foo2 2024-09-16T07:38:59.610 INFO:tasks.workunit.client.0.smithi121.stdout::foo3 2024-09-16T07:38:59.800 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosList.ListObjectsNS (711 ms) 2024-09-16T07:38:59.800 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosList.ListObjectsStart 2024-09-16T07:39:00.115 INFO:tasks.workunit.client.0.smithi121.stdout:1 0 2024-09-16T07:39:00.115 INFO:tasks.workunit.client.0.smithi121.stdout:10 0 2024-09-16T07:39:00.115 INFO:tasks.workunit.client.0.smithi121.stdout:13 0 2024-09-16T07:39:00.115 INFO:tasks.workunit.client.0.smithi121.stdout:7 0 2024-09-16T07:39:00.115 INFO:tasks.workunit.client.0.smithi121.stdout:14 0 2024-09-16T07:39:00.115 INFO:tasks.workunit.client.0.smithi121.stdout:0 0 2024-09-16T07:39:00.115 INFO:tasks.workunit.client.0.smithi121.stdout:15 0 2024-09-16T07:39:00.115 INFO:tasks.workunit.client.0.smithi121.stdout:11 0 2024-09-16T07:39:00.115 INFO:tasks.workunit.client.0.smithi121.stdout:5 0 2024-09-16T07:39:00.115 INFO:tasks.workunit.client.0.smithi121.stdout:8 0 2024-09-16T07:39:00.116 INFO:tasks.workunit.client.0.smithi121.stdout:6 0 2024-09-16T07:39:00.116 INFO:tasks.workunit.client.0.smithi121.stdout:3 0 2024-09-16T07:39:00.116 INFO:tasks.workunit.client.0.smithi121.stdout:4 0 2024-09-16T07:39:00.116 INFO:tasks.workunit.client.0.smithi121.stdout:12 0 2024-09-16T07:39:00.116 INFO:tasks.workunit.client.0.smithi121.stdout:9 0 2024-09-16T07:39:00.116 INFO:tasks.workunit.client.0.smithi121.stdout:2 0 2024-09-16T07:39:00.213 INFO:tasks.workunit.client.0.smithi121.stdout:have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2024-09-16T07:39:00.496 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosList.ListObjectsStart (695 ms) 2024-09-16T07:39:00.496 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosList.ListObjectsCursor 2024-09-16T07:39:00.696 INFO:tasks.workunit.client.0.smithi121.stdout:x cursor=MIN 2024-09-16T07:39:00.797 INFO:tasks.workunit.client.0.smithi121.stdout:> oid=1 cursor=76:02547ec2:::1:head 2024-09-16T07:39:00.797 INFO:tasks.workunit.client.0.smithi121.stdout:> oid=10 cursor=76:52ea6a34:::10:head 2024-09-16T07:39:00.797 INFO:tasks.workunit.client.0.smithi121.stdout:> oid=13 cursor=76:566253c9:::13:head 2024-09-16T07:39:00.797 INFO:tasks.workunit.client.0.smithi121.stdout:> oid=7 cursor=76:5c6b0b28:::7:head 2024-09-16T07:39:00.797 INFO:tasks.workunit.client.0.smithi121.stdout:> oid=14 cursor=76:62a1935d:::14:head 2024-09-16T07:39:00.797 INFO:tasks.workunit.client.0.smithi121.stdout:> oid=0 cursor=76:6cac518f:::0:head 2024-09-16T07:39:00.797 INFO:tasks.workunit.client.0.smithi121.stdout:> oid=15 cursor=76:863748b0:::15:head 2024-09-16T07:39:00.797 INFO:tasks.workunit.client.0.smithi121.stdout:> oid=11 cursor=76:89d3ae78:::11:head 2024-09-16T07:39:00.797 INFO:tasks.workunit.client.0.smithi121.stdout:> oid=5 cursor=76:b29083e3:::5:head 2024-09-16T07:39:00.798 INFO:tasks.workunit.client.0.smithi121.stdout:> oid=8 cursor=76:bd63b0f1:::8:head 2024-09-16T07:39:00.798 INFO:tasks.workunit.client.0.smithi121.stdout:> oid=6 cursor=76:c4fdafeb:::6:head 2024-09-16T07:39:00.798 INFO:tasks.workunit.client.0.smithi121.stdout:> oid=3 cursor=76:cfc208b3:::3:head 2024-09-16T07:39:00.798 INFO:tasks.workunit.client.0.smithi121.stdout:> oid=4 cursor=76:d83876eb:::4:head 2024-09-16T07:39:00.798 INFO:tasks.workunit.client.0.smithi121.stdout:> oid=12 cursor=76:de5d7c5f:::12:head 2024-09-16T07:39:00.798 INFO:tasks.workunit.client.0.smithi121.stdout:> oid=9 cursor=76:e960b815:::9:head 2024-09-16T07:39:00.798 INFO:tasks.workunit.client.0.smithi121.stdout:> oid=2 cursor=76:f905c69b:::2:head 2024-09-16T07:39:00.899 INFO:tasks.workunit.client.0.smithi121.stdout:FIRST> seek to MIN oid=1 2024-09-16T07:39:00.997 INFO:tasks.workunit.client.0.smithi121.stdout:: oid=1 cursor=76:02547ec2:::1:head 2024-09-16T07:39:00.997 INFO:tasks.workunit.client.0.smithi121.stdout:: seek to 76:02547ec2:::1:head 2024-09-16T07:39:01.096 INFO:tasks.workunit.client.0.smithi121.stdout:> 76:02547ec2:::1:head -> 1 2024-09-16T07:39:01.096 INFO:tasks.workunit.client.0.smithi121.stdout:: oid=10 cursor=76:52ea6a34:::10:head 2024-09-16T07:39:01.096 INFO:tasks.workunit.client.0.smithi121.stdout:: seek to 76:52ea6a34:::10:head 2024-09-16T07:39:01.164 INFO:tasks.workunit.client.0.smithi121.stdout:> 76:52ea6a34:::10:head -> 10 2024-09-16T07:39:01.164 INFO:tasks.workunit.client.0.smithi121.stdout:: oid=13 cursor=76:566253c9:::13:head 2024-09-16T07:39:01.164 INFO:tasks.workunit.client.0.smithi121.stdout:: seek to 76:566253c9:::13:head 2024-09-16T07:39:01.236 INFO:tasks.workunit.client.0.smithi121.stdout:> 76:566253c9:::13:head -> 13 2024-09-16T07:39:01.237 INFO:tasks.workunit.client.0.smithi121.stdout:: oid=7 cursor=76:5c6b0b28:::7:head 2024-09-16T07:39:01.237 INFO:tasks.workunit.client.0.smithi121.stdout:: seek to 76:5c6b0b28:::7:head 2024-09-16T07:39:01.303 INFO:tasks.workunit.client.0.smithi121.stdout:> 76:5c6b0b28:::7:head -> 7 2024-09-16T07:39:01.303 INFO:tasks.workunit.client.0.smithi121.stdout:: oid=14 cursor=76:62a1935d:::14:head 2024-09-16T07:39:01.303 INFO:tasks.workunit.client.0.smithi121.stdout:: seek to 76:62a1935d:::14:head 2024-09-16T07:39:01.364 INFO:tasks.workunit.client.0.smithi121.stdout:> 76:62a1935d:::14:head -> 14 2024-09-16T07:39:01.364 INFO:tasks.workunit.client.0.smithi121.stdout:: oid=0 cursor=76:6cac518f:::0:head 2024-09-16T07:39:01.364 INFO:tasks.workunit.client.0.smithi121.stdout:: seek to 76:6cac518f:::0:head 2024-09-16T07:39:01.422 INFO:tasks.workunit.client.0.smithi121.stdout:> 76:6cac518f:::0:head -> 0 2024-09-16T07:39:01.422 INFO:tasks.workunit.client.0.smithi121.stdout:: oid=15 cursor=76:863748b0:::15:head 2024-09-16T07:39:01.422 INFO:tasks.workunit.client.0.smithi121.stdout:: seek to 76:863748b0:::15:head 2024-09-16T07:39:01.471 INFO:tasks.workunit.client.0.smithi121.stdout:> 76:863748b0:::15:head -> 15 2024-09-16T07:39:01.471 INFO:tasks.workunit.client.0.smithi121.stdout:: oid=11 cursor=76:89d3ae78:::11:head 2024-09-16T07:39:01.471 INFO:tasks.workunit.client.0.smithi121.stdout:: seek to 76:89d3ae78:::11:head 2024-09-16T07:39:01.517 INFO:tasks.workunit.client.0.smithi121.stdout:> 76:89d3ae78:::11:head -> 11 2024-09-16T07:39:01.517 INFO:tasks.workunit.client.0.smithi121.stdout:: oid=5 cursor=76:b29083e3:::5:head 2024-09-16T07:39:01.517 INFO:tasks.workunit.client.0.smithi121.stdout:: seek to 76:b29083e3:::5:head 2024-09-16T07:39:01.548 INFO:tasks.workunit.client.0.smithi121.stdout:> 76:b29083e3:::5:head -> 5 2024-09-16T07:39:01.548 INFO:tasks.workunit.client.0.smithi121.stdout:: oid=8 cursor=76:bd63b0f1:::8:head 2024-09-16T07:39:01.548 INFO:tasks.workunit.client.0.smithi121.stdout:: seek to 76:bd63b0f1:::8:head 2024-09-16T07:39:01.576 INFO:tasks.workunit.client.0.smithi121.stdout:> 76:bd63b0f1:::8:head -> 8 2024-09-16T07:39:01.576 INFO:tasks.workunit.client.0.smithi121.stdout:: oid=6 cursor=76:c4fdafeb:::6:head 2024-09-16T07:39:01.576 INFO:tasks.workunit.client.0.smithi121.stdout:: seek to 76:c4fdafeb:::6:head 2024-09-16T07:39:01.600 INFO:tasks.workunit.client.0.smithi121.stdout:> 76:c4fdafeb:::6:head -> 6 2024-09-16T07:39:01.600 INFO:tasks.workunit.client.0.smithi121.stdout:: oid=3 cursor=76:cfc208b3:::3:head 2024-09-16T07:39:01.600 INFO:tasks.workunit.client.0.smithi121.stdout:: seek to 76:cfc208b3:::3:head 2024-09-16T07:39:01.621 INFO:tasks.workunit.client.0.smithi121.stdout:> 76:cfc208b3:::3:head -> 3 2024-09-16T07:39:01.622 INFO:tasks.workunit.client.0.smithi121.stdout:: oid=4 cursor=76:d83876eb:::4:head 2024-09-16T07:39:01.622 INFO:tasks.workunit.client.0.smithi121.stdout:: seek to 76:d83876eb:::4:head 2024-09-16T07:39:01.638 INFO:tasks.workunit.client.0.smithi121.stdout:> 76:d83876eb:::4:head -> 4 2024-09-16T07:39:01.638 INFO:tasks.workunit.client.0.smithi121.stdout:: oid=12 cursor=76:de5d7c5f:::12:head 2024-09-16T07:39:01.638 INFO:tasks.workunit.client.0.smithi121.stdout:: seek to 76:de5d7c5f:::12:head 2024-09-16T07:39:01.654 INFO:tasks.workunit.client.0.smithi121.stdout:> 76:de5d7c5f:::12:head -> 12 2024-09-16T07:39:01.654 INFO:tasks.workunit.client.0.smithi121.stdout:: oid=9 cursor=76:e960b815:::9:head 2024-09-16T07:39:01.654 INFO:tasks.workunit.client.0.smithi121.stdout:: seek to 76:e960b815:::9:head 2024-09-16T07:39:01.663 INFO:tasks.workunit.client.0.smithi121.stdout:> 76:e960b815:::9:head -> 9 2024-09-16T07:39:01.663 INFO:tasks.workunit.client.0.smithi121.stdout:: oid=2 cursor=76:f905c69b:::2:head 2024-09-16T07:39:01.663 INFO:tasks.workunit.client.0.smithi121.stdout:: seek to 76:f905c69b:::2:head 2024-09-16T07:39:01.666 INFO:tasks.workunit.client.0.smithi121.stdout:> 76:f905c69b:::2:head -> 2 2024-09-16T07:39:01.666 INFO:tasks.workunit.client.0.smithi121.stdout:: seek to 76:6cac518f:::0:head 2024-09-16T07:39:01.666 INFO:tasks.workunit.client.0.smithi121.stdout:: cursor()=76:6cac518f:::0:head expected=76:6cac518f:::0:head 2024-09-16T07:39:01.724 INFO:tasks.workunit.client.0.smithi121.stdout:> 76:6cac518f:::0:head -> 0 2024-09-16T07:39:01.725 INFO:tasks.workunit.client.0.smithi121.stdout:: entry=0 expected=0 2024-09-16T07:39:01.725 INFO:tasks.workunit.client.0.smithi121.stdout:: seek to 76:b29083e3:::5:head 2024-09-16T07:39:01.725 INFO:tasks.workunit.client.0.smithi121.stdout:: cursor()=76:b29083e3:::5:head expected=76:b29083e3:::5:head 2024-09-16T07:39:01.755 INFO:tasks.workunit.client.0.smithi121.stdout:> 76:b29083e3:::5:head -> 5 2024-09-16T07:39:01.755 INFO:tasks.workunit.client.0.smithi121.stdout:: entry=5 expected=5 2024-09-16T07:39:01.756 INFO:tasks.workunit.client.0.smithi121.stdout:: seek to 76:52ea6a34:::10:head 2024-09-16T07:39:01.756 INFO:tasks.workunit.client.0.smithi121.stdout:: cursor()=76:52ea6a34:::10:head expected=76:52ea6a34:::10:head 2024-09-16T07:39:01.825 INFO:tasks.workunit.client.0.smithi121.stdout:> 76:52ea6a34:::10:head -> 10 2024-09-16T07:39:01.825 INFO:tasks.workunit.client.0.smithi121.stdout:: entry=10 expected=10 2024-09-16T07:39:01.825 INFO:tasks.workunit.client.0.smithi121.stdout:: seek to 76:02547ec2:::1:head 2024-09-16T07:39:01.825 INFO:tasks.workunit.client.0.smithi121.stdout:: cursor()=76:02547ec2:::1:head expected=76:02547ec2:::1:head 2024-09-16T07:39:01.924 INFO:tasks.workunit.client.0.smithi121.stdout:> 76:02547ec2:::1:head -> 1 2024-09-16T07:39:01.924 INFO:tasks.workunit.client.0.smithi121.stdout:: entry=1 expected=1 2024-09-16T07:39:01.924 INFO:tasks.workunit.client.0.smithi121.stdout:: seek to 76:de5d7c5f:::12:head 2024-09-16T07:39:01.924 INFO:tasks.workunit.client.0.smithi121.stdout:: cursor()=76:de5d7c5f:::12:head expected=76:de5d7c5f:::12:head 2024-09-16T07:39:01.941 INFO:tasks.workunit.client.0.smithi121.stdout:> 76:de5d7c5f:::12:head -> 12 2024-09-16T07:39:01.941 INFO:tasks.workunit.client.0.smithi121.stdout:: entry=12 expected=12 2024-09-16T07:39:01.941 INFO:tasks.workunit.client.0.smithi121.stdout:: seek to 76:d83876eb:::4:head 2024-09-16T07:39:01.941 INFO:tasks.workunit.client.0.smithi121.stdout:: cursor()=76:d83876eb:::4:head expected=76:d83876eb:::4:head 2024-09-16T07:39:01.956 INFO:tasks.workunit.client.0.smithi121.stdout:> 76:d83876eb:::4:head -> 4 2024-09-16T07:39:01.956 INFO:tasks.workunit.client.0.smithi121.stdout:: entry=4 expected=4 2024-09-16T07:39:01.956 INFO:tasks.workunit.client.0.smithi121.stdout:: seek to 76:cfc208b3:::3:head 2024-09-16T07:39:01.957 INFO:tasks.workunit.client.0.smithi121.stdout:: cursor()=76:cfc208b3:::3:head expected=76:cfc208b3:::3:head 2024-09-16T07:39:01.978 INFO:tasks.workunit.client.0.smithi121.stdout:> 76:cfc208b3:::3:head -> 3 2024-09-16T07:39:01.978 INFO:tasks.workunit.client.0.smithi121.stdout:: entry=3 expected=3 2024-09-16T07:39:01.978 INFO:tasks.workunit.client.0.smithi121.stdout:: seek to 76:c4fdafeb:::6:head 2024-09-16T07:39:01.978 INFO:tasks.workunit.client.0.smithi121.stdout:: cursor()=76:c4fdafeb:::6:head expected=76:c4fdafeb:::6:head 2024-09-16T07:39:02.003 INFO:tasks.workunit.client.0.smithi121.stdout:> 76:c4fdafeb:::6:head -> 6 2024-09-16T07:39:02.003 INFO:tasks.workunit.client.0.smithi121.stdout:: entry=6 expected=6 2024-09-16T07:39:02.003 INFO:tasks.workunit.client.0.smithi121.stdout:: seek to 76:bd63b0f1:::8:head 2024-09-16T07:39:02.003 INFO:tasks.workunit.client.0.smithi121.stdout:: cursor()=76:bd63b0f1:::8:head expected=76:bd63b0f1:::8:head 2024-09-16T07:39:02.031 INFO:tasks.workunit.client.0.smithi121.stdout:> 76:bd63b0f1:::8:head -> 8 2024-09-16T07:39:02.032 INFO:tasks.workunit.client.0.smithi121.stdout:: entry=8 expected=8 2024-09-16T07:39:02.032 INFO:tasks.workunit.client.0.smithi121.stdout:: seek to 76:89d3ae78:::11:head 2024-09-16T07:39:02.032 INFO:tasks.workunit.client.0.smithi121.stdout:: cursor()=76:89d3ae78:::11:head expected=76:89d3ae78:::11:head 2024-09-16T07:39:02.079 INFO:tasks.workunit.client.0.smithi121.stdout:> 76:89d3ae78:::11:head -> 11 2024-09-16T07:39:02.079 INFO:tasks.workunit.client.0.smithi121.stdout:: entry=11 expected=11 2024-09-16T07:39:02.079 INFO:tasks.workunit.client.0.smithi121.stdout:: seek to 76:863748b0:::15:head 2024-09-16T07:39:02.079 INFO:tasks.workunit.client.0.smithi121.stdout:: cursor()=76:863748b0:::15:head expected=76:863748b0:::15:head 2024-09-16T07:39:02.128 INFO:tasks.workunit.client.0.smithi121.stdout:> 76:863748b0:::15:head -> 15 2024-09-16T07:39:02.129 INFO:tasks.workunit.client.0.smithi121.stdout:: entry=15 expected=15 2024-09-16T07:39:02.129 INFO:tasks.workunit.client.0.smithi121.stdout:: seek to 76:62a1935d:::14:head 2024-09-16T07:39:02.129 INFO:tasks.workunit.client.0.smithi121.stdout:: cursor()=76:62a1935d:::14:head expected=76:62a1935d:::14:head 2024-09-16T07:39:02.191 INFO:tasks.workunit.client.0.smithi121.stdout:> 76:62a1935d:::14:head -> 14 2024-09-16T07:39:02.191 INFO:tasks.workunit.client.0.smithi121.stdout:: entry=14 expected=14 2024-09-16T07:39:02.191 INFO:tasks.workunit.client.0.smithi121.stdout:: seek to 76:5c6b0b28:::7:head 2024-09-16T07:39:02.191 INFO:tasks.workunit.client.0.smithi121.stdout:: cursor()=76:5c6b0b28:::7:head expected=76:5c6b0b28:::7:head 2024-09-16T07:39:02.256 INFO:tasks.workunit.client.0.smithi121.stdout:> 76:5c6b0b28:::7:head -> 7 2024-09-16T07:39:02.256 INFO:tasks.workunit.client.0.smithi121.stdout:: entry=7 expected=7 2024-09-16T07:39:02.256 INFO:tasks.workunit.client.0.smithi121.stdout:: seek to 76:f905c69b:::2:head 2024-09-16T07:39:02.256 INFO:tasks.workunit.client.0.smithi121.stdout:: cursor()=76:f905c69b:::2:head expected=76:f905c69b:::2:head 2024-09-16T07:39:02.258 INFO:tasks.workunit.client.0.smithi121.stdout:> 76:f905c69b:::2:head -> 2 2024-09-16T07:39:02.258 INFO:tasks.workunit.client.0.smithi121.stdout:: entry=2 expected=2 2024-09-16T07:39:02.258 INFO:tasks.workunit.client.0.smithi121.stdout:: seek to 76:e960b815:::9:head 2024-09-16T07:39:02.259 INFO:tasks.workunit.client.0.smithi121.stdout:: cursor()=76:e960b815:::9:head expected=76:e960b815:::9:head 2024-09-16T07:39:02.268 INFO:tasks.workunit.client.0.smithi121.stdout:> 76:e960b815:::9:head -> 9 2024-09-16T07:39:02.268 INFO:tasks.workunit.client.0.smithi121.stdout:: entry=9 expected=9 2024-09-16T07:39:02.268 INFO:tasks.workunit.client.0.smithi121.stdout:: seek to 76:566253c9:::13:head 2024-09-16T07:39:02.268 INFO:tasks.workunit.client.0.smithi121.stdout:: cursor()=76:566253c9:::13:head expected=76:566253c9:::13:head 2024-09-16T07:39:02.337 INFO:tasks.workunit.client.0.smithi121.stdout:> 76:566253c9:::13:head -> 13 2024-09-16T07:39:02.337 INFO:tasks.workunit.client.0.smithi121.stdout:: entry=13 expected=13 2024-09-16T07:39:02.623 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosList.ListObjectsCursor (2128 ms) 2024-09-16T07:39:02.624 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosList.EnumerateObjects 2024-09-16T07:39:03.217 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosList.EnumerateObjects (593 ms) 2024-09-16T07:39:03.217 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosList.EnumerateObjectsSplit 2024-09-16T07:39:03.421 INFO:tasks.workunit.client.0.smithi121.stdout:split 0/5 -> MIN 76:33333333::::head 2024-09-16T07:39:03.443 INFO:tasks.workunit.client.0.smithi121.stdout:split 1/5 -> 76:33333333::::head 76:66666666::::head 2024-09-16T07:39:03.466 INFO:tasks.workunit.client.0.smithi121.stdout:split 2/5 -> 76:66666666::::head 76:99999999::::head 2024-09-16T07:39:03.491 INFO:tasks.workunit.client.0.smithi121.stdout:split 3/5 -> 76:99999999::::head 76:cccccccc::::head 2024-09-16T07:39:03.512 INFO:tasks.workunit.client.0.smithi121.stdout:split 4/5 -> 76:cccccccc::::head MAX 2024-09-16T07:39:03.821 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosList.EnumerateObjectsSplit (605 ms) 2024-09-16T07:39:04.426 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 7 tests from LibRadosList (5492 ms total) 2024-09-16T07:39:04.426 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:39:04.426 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 3 tests from LibRadosListEC 2024-09-16T07:39:04.427 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:70: Skipped 2024-09-16T07:39:04.427 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:39:04.427 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosListEC.ListObjects 2024-09-16T07:39:04.427 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:84: Skipped 2024-09-16T07:39:04.427 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:39:04.427 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:96: Skipped 2024-09-16T07:39:04.427 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:39:04.427 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosListEC.ListObjects (0 ms) 2024-09-16T07:39:04.427 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosListEC.ListObjectsNS 2024-09-16T07:39:04.427 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:84: Skipped 2024-09-16T07:39:04.427 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:39:04.427 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:96: Skipped 2024-09-16T07:39:04.427 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:39:04.428 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosListEC.ListObjectsNS (0 ms) 2024-09-16T07:39:04.428 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosListEC.ListObjectsStart 2024-09-16T07:39:04.428 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:84: Skipped 2024-09-16T07:39:04.428 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:39:04.428 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:96: Skipped 2024-09-16T07:39:04.428 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:39:04.428 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosListEC.ListObjectsStart (0 ms) 2024-09-16T07:39:04.428 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:78: Skipped 2024-09-16T07:39:04.428 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:39:04.428 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 3 tests from LibRadosListEC (0 ms total) 2024-09-16T07:39:04.428 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:39:04.428 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 1 test from LibRadosListNP 2024-09-16T07:39:04.428 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosListNP.ListObjectsError 2024-09-16T07:39:07.332 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosListNP.ListObjectsError (2906 ms) 2024-09-16T07:39:07.332 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 1 test from LibRadosListNP (2906 ms total) 2024-09-16T07:39:07.332 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:39:07.332 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment tear-down 2024-09-16T07:39:07.332 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] 11 tests from 3 test suites ran. (10542 ms total) 2024-09-16T07:39:07.332 INFO:tasks.workunit.client.0.smithi121.stdout:[ PASSED ] 8 tests. 2024-09-16T07:39:07.332 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] 3 tests, listed below: 2024-09-16T07:39:07.332 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosListEC.ListObjects 2024-09-16T07:39:07.332 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosListEC.ListObjectsNS 2024-09-16T07:39:07.332 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosListEC.ListObjectsStart 2024-09-16T07:39:07.334 INFO:tasks.workunit.client.0.smithi121.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T07:39:07.335 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T07:39:07.335 INFO:tasks.workunit.client.0.smithi121.stderr:+ ceph_test_rados_api_lock 2024-09-16T07:39:07.357 INFO:tasks.workunit.client.0.smithi121.stdout:Running main() from gmock_main.cc 2024-09-16T07:39:07.357 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] Running 16 tests from 2 test suites. 2024-09-16T07:39:07.357 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment set-up. 2024-09-16T07:39:07.357 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 8 tests from LibRadosLock 2024-09-16T07:39:09.333 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosLock.LockExclusive 2024-09-16T07:39:09.557 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosLock.LockExclusive (225 ms) 2024-09-16T07:39:09.557 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosLock.LockShared 2024-09-16T07:39:09.653 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosLock.LockShared (96 ms) 2024-09-16T07:39:09.654 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosLock.LockExclusiveDur 2024-09-16T07:39:10.695 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosLock.LockExclusiveDur (1041 ms) 2024-09-16T07:39:10.695 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosLock.LockSharedDur 2024-09-16T07:39:11.739 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosLock.LockSharedDur (1044 ms) 2024-09-16T07:39:11.739 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosLock.LockMayRenew 2024-09-16T07:39:11.786 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosLock.LockMayRenew (48 ms) 2024-09-16T07:39:11.786 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosLock.Unlock 2024-09-16T07:39:11.831 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosLock.Unlock (45 ms) 2024-09-16T07:39:11.832 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosLock.ListLockers 2024-09-16T07:39:11.893 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosLock.ListLockers (62 ms) 2024-09-16T07:39:11.893 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosLock.BreakLock 2024-09-16T07:39:11.927 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosLock.BreakLock (34 ms) 2024-09-16T07:39:12.334 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 8 tests from LibRadosLock (2595 ms total) 2024-09-16T07:39:12.334 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:39:12.334 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 8 tests from LibRadosLockEC 2024-09-16T07:39:12.334 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:168: Skipped 2024-09-16T07:39:12.334 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:39:12.334 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosLockEC.LockExclusive 2024-09-16T07:39:12.334 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T07:39:12.335 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:39:12.335 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T07:39:12.335 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:39:12.335 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosLockEC.LockExclusive (0 ms) 2024-09-16T07:39:12.335 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosLockEC.LockShared 2024-09-16T07:39:12.335 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T07:39:12.335 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:39:12.335 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T07:39:12.335 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:39:12.335 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosLockEC.LockShared (0 ms) 2024-09-16T07:39:12.335 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosLockEC.LockExclusiveDur 2024-09-16T07:39:12.335 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T07:39:12.335 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:39:12.335 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T07:39:12.336 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:39:12.336 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosLockEC.LockExclusiveDur (0 ms) 2024-09-16T07:39:12.336 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosLockEC.LockSharedDur 2024-09-16T07:39:12.336 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T07:39:12.336 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:39:12.336 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T07:39:12.336 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:39:12.336 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosLockEC.LockSharedDur (0 ms) 2024-09-16T07:39:12.336 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosLockEC.LockMayRenew 2024-09-16T07:39:12.336 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T07:39:12.336 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:39:12.337 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T07:39:12.337 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:39:12.337 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosLockEC.LockMayRenew (0 ms) 2024-09-16T07:39:12.337 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosLockEC.Unlock 2024-09-16T07:39:12.337 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T07:39:12.337 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:39:12.337 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T07:39:12.337 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:39:12.337 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosLockEC.Unlock (0 ms) 2024-09-16T07:39:12.337 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosLockEC.ListLockers 2024-09-16T07:39:12.337 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T07:39:12.337 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:39:12.337 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T07:39:12.337 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:39:12.338 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosLockEC.ListLockers (0 ms) 2024-09-16T07:39:12.338 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosLockEC.BreakLock 2024-09-16T07:39:12.338 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T07:39:12.338 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:39:12.338 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T07:39:12.338 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:39:12.338 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosLockEC.BreakLock (0 ms) 2024-09-16T07:39:12.338 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:176: Skipped 2024-09-16T07:39:12.338 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:39:12.338 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 8 tests from LibRadosLockEC (0 ms total) 2024-09-16T07:39:12.338 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:39:12.338 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment tear-down 2024-09-16T07:39:12.338 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] 16 tests from 2 test suites ran. (4975 ms total) 2024-09-16T07:39:12.339 INFO:tasks.workunit.client.0.smithi121.stdout:[ PASSED ] 8 tests. 2024-09-16T07:39:12.339 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] 8 tests, listed below: 2024-09-16T07:39:12.339 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosLockEC.LockExclusive 2024-09-16T07:39:12.339 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosLockEC.LockShared 2024-09-16T07:39:12.339 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosLockEC.LockExclusiveDur 2024-09-16T07:39:12.339 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosLockEC.LockSharedDur 2024-09-16T07:39:12.339 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosLockEC.LockMayRenew 2024-09-16T07:39:12.339 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosLockEC.Unlock 2024-09-16T07:39:12.339 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosLockEC.ListLockers 2024-09-16T07:39:12.339 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosLockEC.BreakLock 2024-09-16T07:39:12.340 INFO:tasks.workunit.client.0.smithi121.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T07:39:12.340 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T07:39:12.340 INFO:tasks.workunit.client.0.smithi121.stderr:+ ceph_test_rados_api_lock_pp 2024-09-16T07:39:12.363 INFO:tasks.workunit.client.0.smithi121.stdout:Running main() from gmock_main.cc 2024-09-16T07:39:12.363 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] Running 16 tests from 2 test suites. 2024-09-16T07:39:12.363 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment set-up. 2024-09-16T07:39:12.363 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 8 tests from LibRadosLockPP 2024-09-16T07:39:12.363 INFO:tasks.workunit.client.0.smithi121.stdout:seed 31290 2024-09-16T07:39:14.342 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosLockPP.LockExclusivePP 2024-09-16T07:39:14.610 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosLockPP.LockExclusivePP (269 ms) 2024-09-16T07:39:14.610 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosLockPP.LockSharedPP 2024-09-16T07:39:14.643 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosLockPP.LockSharedPP (33 ms) 2024-09-16T07:39:14.643 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosLockPP.LockExclusiveDurPP 2024-09-16T07:39:15.689 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosLockPP.LockExclusiveDurPP (1046 ms) 2024-09-16T07:39:15.689 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosLockPP.LockSharedDurPP 2024-09-16T07:39:16.737 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosLockPP.LockSharedDurPP (1047 ms) 2024-09-16T07:39:16.737 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosLockPP.LockMayRenewPP 2024-09-16T07:39:16.776 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosLockPP.LockMayRenewPP (40 ms) 2024-09-16T07:39:16.776 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosLockPP.UnlockPP 2024-09-16T07:39:16.819 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosLockPP.UnlockPP (42 ms) 2024-09-16T07:39:16.819 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosLockPP.ListLockersPP 2024-09-16T07:39:16.880 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosLockPP.ListLockersPP (62 ms) 2024-09-16T07:39:16.880 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosLockPP.BreakLockPP 2024-09-16T07:39:16.917 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosLockPP.BreakLockPP (36 ms) 2024-09-16T07:39:17.339 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 8 tests from LibRadosLockPP (2575 ms total) 2024-09-16T07:39:17.339 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:39:17.339 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 8 tests from LibRadosLockECPP 2024-09-16T07:39:17.339 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:375: Skipped 2024-09-16T07:39:17.339 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:39:17.339 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosLockECPP.LockExclusivePP 2024-09-16T07:39:17.340 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T07:39:17.340 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:39:17.340 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T07:39:17.340 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:39:17.340 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosLockECPP.LockExclusivePP (0 ms) 2024-09-16T07:39:17.340 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosLockECPP.LockSharedPP 2024-09-16T07:39:17.340 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T07:39:17.340 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:39:17.340 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T07:39:17.340 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:39:17.340 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosLockECPP.LockSharedPP (0 ms) 2024-09-16T07:39:17.340 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosLockECPP.LockExclusiveDurPP 2024-09-16T07:39:17.340 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T07:39:17.341 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:39:17.341 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T07:39:17.341 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:39:17.341 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosLockECPP.LockExclusiveDurPP (0 ms) 2024-09-16T07:39:17.341 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosLockECPP.LockSharedDurPP 2024-09-16T07:39:17.341 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T07:39:17.341 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:39:17.341 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T07:39:17.341 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:39:17.341 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosLockECPP.LockSharedDurPP (0 ms) 2024-09-16T07:39:17.341 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosLockECPP.LockMayRenewPP 2024-09-16T07:39:17.341 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T07:39:17.341 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:39:17.341 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T07:39:17.342 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:39:17.342 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosLockECPP.LockMayRenewPP (0 ms) 2024-09-16T07:39:17.342 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosLockECPP.UnlockPP 2024-09-16T07:39:17.342 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T07:39:17.342 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:39:17.342 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T07:39:17.342 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:39:17.342 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosLockECPP.UnlockPP (0 ms) 2024-09-16T07:39:17.342 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosLockECPP.ListLockersPP 2024-09-16T07:39:17.342 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T07:39:17.342 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:39:17.342 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T07:39:17.342 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:39:17.342 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosLockECPP.ListLockersPP (0 ms) 2024-09-16T07:39:17.343 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosLockECPP.BreakLockPP 2024-09-16T07:39:17.343 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T07:39:17.343 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:39:17.343 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T07:39:17.343 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:39:17.343 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosLockECPP.BreakLockPP (0 ms) 2024-09-16T07:39:17.343 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:383: Skipped 2024-09-16T07:39:17.343 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:39:17.343 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 8 tests from LibRadosLockECPP (0 ms total) 2024-09-16T07:39:17.343 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:39:17.343 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment tear-down 2024-09-16T07:39:17.343 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] 16 tests from 2 test suites ran. (4974 ms total) 2024-09-16T07:39:17.343 INFO:tasks.workunit.client.0.smithi121.stdout:[ PASSED ] 8 tests. 2024-09-16T07:39:17.344 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] 8 tests, listed below: 2024-09-16T07:39:17.344 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosLockECPP.LockExclusivePP 2024-09-16T07:39:17.344 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosLockECPP.LockSharedPP 2024-09-16T07:39:17.344 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosLockECPP.LockExclusiveDurPP 2024-09-16T07:39:17.344 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosLockECPP.LockSharedDurPP 2024-09-16T07:39:17.344 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosLockECPP.LockMayRenewPP 2024-09-16T07:39:17.344 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosLockECPP.UnlockPP 2024-09-16T07:39:17.344 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosLockECPP.ListLockersPP 2024-09-16T07:39:17.344 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosLockECPP.BreakLockPP 2024-09-16T07:39:17.345 INFO:tasks.workunit.client.0.smithi121.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T07:39:17.345 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T07:39:17.348 INFO:tasks.workunit.client.0.smithi121.stderr:+ ceph_test_rados_api_misc 2024-09-16T07:39:17.397 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:39:17.397+0000 7f0c316df6c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:17.397 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:39:17.397+0000 7f0c316df6c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:17.397 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:39:17.397+0000 7f0c316df6c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:17.398 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] Running 12 tests from 4 test suites. 2024-09-16T07:39:17.398 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment set-up. 2024-09-16T07:39:17.399 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 1 test from LibRadosMiscVersion 2024-09-16T07:39:17.399 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosMiscVersion.Version 2024-09-16T07:39:17.399 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosMiscVersion.Version (0 ms) 2024-09-16T07:39:17.399 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 1 test from LibRadosMiscVersion (0 ms total) 2024-09-16T07:39:17.399 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:39:17.400 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 2 tests from LibRadosMiscConnectFailure 2024-09-16T07:39:17.400 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosMiscConnectFailure.ConnectFailure 2024-09-16T07:39:17.446 INFO:tasks.workunit.client.0.smithi121.stderr:unable to get monitor info from DNS SRV with service name: ceph-mon 2024-09-16T07:39:17.446 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:39:17.446+0000 7f0c316df6c0 -1 failed for service _ceph-mon._tcp 2024-09-16T07:39:17.446 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:39:17.446+0000 7f0c316df6c0 -1 monclient: get_monmap_and_config cannot identify monitors to contact 2024-09-16T07:39:17.446 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosMiscConnectFailure.ConnectFailure (49 ms) 2024-09-16T07:39:17.446 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosMiscConnectFailure.ConnectTimeout 2024-09-16T07:39:22.453 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosMiscConnectFailure.ConnectTimeout (5008 ms) 2024-09-16T07:39:22.454 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 2 tests from LibRadosMiscConnectFailure (5057 ms total) 2024-09-16T07:39:22.454 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:39:22.454 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 1 test from LibRadosMiscPool 2024-09-16T07:39:22.454 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosMiscPool.PoolCreationRace 2024-09-16T07:39:25.369 INFO:tasks.workunit.client.0.smithi121.stdout:started 0x7f0c00005de0 2024-09-16T07:39:26.369 INFO:tasks.workunit.client.0.smithi121.stdout:started 0x7f0c14005de0 2024-09-16T07:39:26.370 INFO:tasks.workunit.client.0.smithi121.stdout: started 2 aios 2024-09-16T07:39:26.370 INFO:tasks.workunit.client.0.smithi121.stdout:waiting 0x7f0c00005de0 2024-09-16T07:39:26.370 INFO:tasks.workunit.client.0.smithi121.stdout:waiting 0x7f0c14005de0 2024-09-16T07:39:26.375 INFO:tasks.workunit.client.0.smithi121.stdout:done. 2024-09-16T07:39:28.385 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosMiscPool.PoolCreationRace (5932 ms) 2024-09-16T07:39:28.386 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 1 test from LibRadosMiscPool (5932 ms total) 2024-09-16T07:39:28.386 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:39:28.386 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 8 tests from LibRadosMisc 2024-09-16T07:39:30.395 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosMisc.ClusterFSID 2024-09-16T07:39:30.396 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosMisc.ClusterFSID (0 ms) 2024-09-16T07:39:30.396 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosMisc.Exec 2024-09-16T07:39:30.666 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosMisc.Exec (270 ms) 2024-09-16T07:39:30.666 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosMisc.WriteSame 2024-09-16T07:39:30.732 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosMisc.WriteSame (67 ms) 2024-09-16T07:39:30.732 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosMisc.CmpExt 2024-09-16T07:39:30.759 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosMisc.CmpExt (27 ms) 2024-09-16T07:39:30.759 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosMisc.Applications 2024-09-16T07:39:35.351 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosMisc.Applications (4591 ms) 2024-09-16T07:39:35.351 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosMisc.MinCompatOSD 2024-09-16T07:39:35.351 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosMisc.MinCompatOSD (0 ms) 2024-09-16T07:39:35.351 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosMisc.MinCompatClient 2024-09-16T07:39:35.351 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosMisc.MinCompatClient (0 ms) 2024-09-16T07:39:35.351 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosMisc.ShutdownRace 2024-09-16T07:40:01.741 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosMisc.ShutdownRace (26390 ms) 2024-09-16T07:40:02.358 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 8 tests from LibRadosMisc (31345 ms total) 2024-09-16T07:40:02.358 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:40:02.358 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment tear-down 2024-09-16T07:40:02.358 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] 12 tests from 4 test suites ran. (44962 ms total) 2024-09-16T07:40:02.358 INFO:tasks.workunit.client.0.smithi121.stdout:[ PASSED ] 12 tests. 2024-09-16T07:40:02.370 INFO:tasks.workunit.client.0.smithi121.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T07:40:02.370 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T07:40:02.370 INFO:tasks.workunit.client.0.smithi121.stderr:+ ceph_test_rados_api_misc_pp 2024-09-16T07:40:02.423 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] Running 31 tests from 7 test suites. 2024-09-16T07:40:02.423 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment set-up. 2024-09-16T07:40:02.423 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 1 test from LibRadosMiscVersion 2024-09-16T07:40:02.423 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosMiscVersion.VersionPP 2024-09-16T07:40:02.423 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosMiscVersion.VersionPP (0 ms) 2024-09-16T07:40:02.423 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 1 test from LibRadosMiscVersion (0 ms total) 2024-09-16T07:40:02.423 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:40:02.423 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 22 tests from LibRadosMiscPP 2024-09-16T07:40:02.423 INFO:tasks.workunit.client.0.smithi121.stdout:seed 92955 2024-09-16T07:40:02.424 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:40:02.421+0000 7f1d1783a840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:02.424 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:40:02.422+0000 7f1d1783a840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:02.424 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:40:02.422+0000 7f1d1783a840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:04.368 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosMiscPP.WaitOSDMapPP 2024-09-16T07:40:04.371 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosMiscPP.WaitOSDMapPP (4 ms) 2024-09-16T07:40:04.371 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosMiscPP.LongNamePP 2024-09-16T07:40:04.794 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosMiscPP.LongNamePP (423 ms) 2024-09-16T07:40:04.794 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosMiscPP.LongLocatorPP 2024-09-16T07:40:04.794 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/misc_cxx.cc:53: Skipped 2024-09-16T07:40:04.794 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:04.794 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosMiscPP.LongLocatorPP (0 ms) 2024-09-16T07:40:04.794 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosMiscPP.LongNSpacePP 2024-09-16T07:40:04.860 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosMiscPP.LongNSpacePP (66 ms) 2024-09-16T07:40:04.861 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosMiscPP.LongAttrNamePP 2024-09-16T07:40:04.915 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosMiscPP.LongAttrNamePP (55 ms) 2024-09-16T07:40:04.915 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosMiscPP.ExecPP 2024-09-16T07:40:04.933 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosMiscPP.ExecPP (18 ms) 2024-09-16T07:40:04.933 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosMiscPP.BadFlagsPP 2024-09-16T07:40:04.951 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosMiscPP.BadFlagsPP (18 ms) 2024-09-16T07:40:04.951 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosMiscPP.Operate1PP 2024-09-16T07:40:04.981 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosMiscPP.Operate1PP (30 ms) 2024-09-16T07:40:04.981 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosMiscPP.Operate2PP 2024-09-16T07:40:04.998 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosMiscPP.Operate2PP (17 ms) 2024-09-16T07:40:04.998 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosMiscPP.BigObjectPP 2024-09-16T07:40:05.046 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosMiscPP.BigObjectPP (48 ms) 2024-09-16T07:40:05.046 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosMiscPP.AioOperatePP 2024-09-16T07:40:05.064 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosMiscPP.AioOperatePP (18 ms) 2024-09-16T07:40:05.064 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosMiscPP.AssertExistsPP 2024-09-16T07:40:05.090 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosMiscPP.AssertExistsPP (25 ms) 2024-09-16T07:40:05.090 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosMiscPP.AssertVersionPP 2024-09-16T07:40:05.141 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosMiscPP.AssertVersionPP (52 ms) 2024-09-16T07:40:05.141 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosMiscPP.BigAttrPP 2024-09-16T07:40:05.154 INFO:tasks.workunit.client.0.smithi121.stdout:osd_max_attr_size = 0 2024-09-16T07:40:05.154 INFO:tasks.workunit.client.0.smithi121.stdout:osd_max_attr_size == 0; skipping test 2024-09-16T07:40:24.351 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosMiscPP.BigAttrPP (19208 ms) 2024-09-16T07:40:24.351 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosMiscPP.CopyPP 2024-09-16T07:40:24.352 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/misc_cxx.cc:387: Skipped 2024-09-16T07:40:24.352 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:24.352 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosMiscPP.CopyPP (0 ms) 2024-09-16T07:40:24.352 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosMiscPP.CopyScrubPP 2024-09-16T07:40:24.352 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/misc_cxx.cc:550: Skipped 2024-09-16T07:40:24.352 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:24.352 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosMiscPP.CopyScrubPP (0 ms) 2024-09-16T07:40:24.352 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosMiscPP.WriteSamePP 2024-09-16T07:40:24.391 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosMiscPP.WriteSamePP (41 ms) 2024-09-16T07:40:24.391 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosMiscPP.CmpExtPP 2024-09-16T07:40:24.413 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosMiscPP.CmpExtPP (23 ms) 2024-09-16T07:40:24.413 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosMiscPP.Applications 2024-09-16T07:40:29.398 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosMiscPP.Applications (4985 ms) 2024-09-16T07:40:29.398 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosMiscPP.MinCompatOSD 2024-09-16T07:40:29.398 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosMiscPP.MinCompatOSD (0 ms) 2024-09-16T07:40:29.399 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosMiscPP.MinCompatClient 2024-09-16T07:40:29.399 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosMiscPP.MinCompatClient (0 ms) 2024-09-16T07:40:29.399 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosMiscPP.Conf 2024-09-16T07:40:29.399 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosMiscPP.Conf (0 ms) 2024-09-16T07:40:30.398 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 22 tests from LibRadosMiscPP (25031 ms total) 2024-09-16T07:40:30.398 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:40:30.398 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 1 test from LibRadosTwoPoolsECPP 2024-09-16T07:40:30.398 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/misc_cxx.cc:477: Skipped 2024-09-16T07:40:30.398 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:30.398 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTwoPoolsECPP.CopyFrom 2024-09-16T07:40:30.399 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/misc_cxx.cc:499: Skipped 2024-09-16T07:40:30.399 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:30.399 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/misc_cxx.cc:505: Skipped 2024-09-16T07:40:30.399 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:30.399 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.CopyFrom (0 ms) 2024-09-16T07:40:30.399 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/misc_cxx.cc:492: Skipped 2024-09-16T07:40:30.399 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:30.399 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 1 test from LibRadosTwoPoolsECPP (0 ms total) 2024-09-16T07:40:30.399 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:40:30.399 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 2 tests from LibRadosChecksum/0, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)0, Checksummer::xxhash32, ceph_le > 2024-09-16T07:40:32.348 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosChecksum/0.Subset 2024-09-16T07:40:32.678 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosChecksum/0.Subset (330 ms) 2024-09-16T07:40:32.679 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosChecksum/0.Chunked 2024-09-16T07:40:32.698 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosChecksum/0.Chunked (19 ms) 2024-09-16T07:40:33.413 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 2 tests from LibRadosChecksum/0 (349 ms total) 2024-09-16T07:40:33.413 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:40:33.413 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 2 tests from LibRadosChecksum/1, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)1, Checksummer::xxhash64, ceph_le > 2024-09-16T07:40:35.426 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosChecksum/1.Subset 2024-09-16T07:40:35.717 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosChecksum/1.Subset (292 ms) 2024-09-16T07:40:35.718 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosChecksum/1.Chunked 2024-09-16T07:40:35.740 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosChecksum/1.Chunked (22 ms) 2024-09-16T07:40:36.437 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 2 tests from LibRadosChecksum/1 (314 ms total) 2024-09-16T07:40:36.437 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:40:36.437 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 2 tests from LibRadosChecksum/2, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)2, Checksummer::crc32c, ceph_le > 2024-09-16T07:40:38.445 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosChecksum/2.Subset 2024-09-16T07:40:38.723 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosChecksum/2.Subset (278 ms) 2024-09-16T07:40:38.723 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosChecksum/2.Chunked 2024-09-16T07:40:38.746 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosChecksum/2.Chunked (23 ms) 2024-09-16T07:40:39.451 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 2 tests from LibRadosChecksum/2 (301 ms total) 2024-09-16T07:40:39.452 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:40:39.452 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 1 test from LibRadosMiscECPP 2024-09-16T07:40:39.452 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:375: Skipped 2024-09-16T07:40:39.452 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:39.452 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosMiscECPP.CompareExtentRange 2024-09-16T07:40:39.452 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T07:40:39.452 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:39.452 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T07:40:39.452 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:39.452 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosMiscECPP.CompareExtentRange (0 ms) 2024-09-16T07:40:39.452 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:383: Skipped 2024-09-16T07:40:39.453 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:39.453 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 1 test from LibRadosMiscECPP (0 ms total) 2024-09-16T07:40:39.453 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:40:39.453 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment tear-down 2024-09-16T07:40:39.453 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] 31 tests from 7 test suites ran. (37029 ms total) 2024-09-16T07:40:39.453 INFO:tasks.workunit.client.0.smithi121.stdout:[ PASSED ] 26 tests. 2024-09-16T07:40:39.453 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] 5 tests, listed below: 2024-09-16T07:40:39.453 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosMiscPP.LongLocatorPP 2024-09-16T07:40:39.453 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosMiscPP.CopyPP 2024-09-16T07:40:39.453 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosMiscPP.CopyScrubPP 2024-09-16T07:40:39.453 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.CopyFrom 2024-09-16T07:40:39.453 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosMiscECPP.CompareExtentRange 2024-09-16T07:40:39.454 INFO:tasks.workunit.client.0.smithi121.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T07:40:39.454 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T07:40:39.454 INFO:tasks.workunit.client.0.smithi121.stderr:+ ceph_test_rados_api_tier_pp 2024-09-16T07:40:39.491 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:40:39.492+0000 7fde4d90d9c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:39.491 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:40:39.492+0000 7fde4d90d9c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:39.492 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] Running 77 tests from 4 test suites. 2024-09-16T07:40:39.492 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment set-up. 2024-09-16T07:40:39.492 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 3 tests from LibRadosTierPP 2024-09-16T07:40:39.492 INFO:tasks.workunit.client.0.smithi121.stdout:seed 93027 2024-09-16T07:40:39.492 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:40:39.492+0000 7fde4d90d9c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:41.459 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTierPP.Dirty 2024-09-16T07:40:41.460 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:287: Skipped 2024-09-16T07:40:41.460 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:41.460 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTierPP.Dirty (0 ms) 2024-09-16T07:40:41.460 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTierPP.FlushWriteRaces 2024-09-16T07:40:41.460 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:2182: Skipped 2024-09-16T07:40:41.461 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:41.461 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTierPP.FlushWriteRaces (1 ms) 2024-09-16T07:40:41.461 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTierPP.HitSetNone 2024-09-16T07:40:41.461 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:2561: Skipped 2024-09-16T07:40:41.461 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:41.462 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTierPP.HitSetNone (0 ms) 2024-09-16T07:40:42.349 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 3 tests from LibRadosTierPP (1 ms total) 2024-09-16T07:40:42.349 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:40:42.349 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 48 tests from LibRadosTwoPoolsPP 2024-09-16T07:40:44.360 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTwoPoolsPP.Overlay 2024-09-16T07:40:44.361 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T07:40:44.361 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.361 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T07:40:44.361 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.361 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Overlay (0 ms) 2024-09-16T07:40:44.361 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTwoPoolsPP.Promote 2024-09-16T07:40:44.361 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T07:40:44.361 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.361 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T07:40:44.361 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.361 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Promote (0 ms) 2024-09-16T07:40:44.361 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTwoPoolsPP.PromoteSnap 2024-09-16T07:40:44.361 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T07:40:44.362 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.362 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T07:40:44.362 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.362 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnap (0 ms) 2024-09-16T07:40:44.362 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTwoPoolsPP.PromoteSnapScrub 2024-09-16T07:40:44.362 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T07:40:44.362 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.362 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T07:40:44.362 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.362 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnapScrub (0 ms) 2024-09-16T07:40:44.362 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTwoPoolsPP.PromoteSnapTrimRace 2024-09-16T07:40:44.362 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T07:40:44.362 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.362 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T07:40:44.363 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.363 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnapTrimRace (0 ms) 2024-09-16T07:40:44.363 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTwoPoolsPP.Whiteout 2024-09-16T07:40:44.363 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T07:40:44.363 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.363 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T07:40:44.363 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.363 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Whiteout (0 ms) 2024-09-16T07:40:44.363 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate 2024-09-16T07:40:44.363 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T07:40:44.363 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.363 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T07:40:44.363 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.364 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate (0 ms) 2024-09-16T07:40:44.364 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTwoPoolsPP.Evict 2024-09-16T07:40:44.364 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T07:40:44.364 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.364 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T07:40:44.364 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.364 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Evict (0 ms) 2024-09-16T07:40:44.364 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTwoPoolsPP.EvictSnap 2024-09-16T07:40:44.364 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T07:40:44.364 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.364 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T07:40:44.364 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.364 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnap (1 ms) 2024-09-16T07:40:44.365 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTwoPoolsPP.EvictSnap2 2024-09-16T07:40:44.365 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T07:40:44.365 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.365 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T07:40:44.365 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.365 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnap2 (0 ms) 2024-09-16T07:40:44.365 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTwoPoolsPP.ListSnap 2024-09-16T07:40:44.365 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T07:40:44.365 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.365 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T07:40:44.365 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.365 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ListSnap (0 ms) 2024-09-16T07:40:44.365 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace 2024-09-16T07:40:44.366 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T07:40:44.366 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.366 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T07:40:44.366 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.366 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace (0 ms) 2024-09-16T07:40:44.366 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTwoPoolsPP.TryFlush 2024-09-16T07:40:44.366 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T07:40:44.366 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.366 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T07:40:44.366 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.366 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TryFlush (0 ms) 2024-09-16T07:40:44.366 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTwoPoolsPP.Flush 2024-09-16T07:40:44.366 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T07:40:44.366 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.367 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T07:40:44.367 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.367 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Flush (0 ms) 2024-09-16T07:40:44.367 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTwoPoolsPP.FlushSnap 2024-09-16T07:40:44.367 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T07:40:44.367 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.367 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T07:40:44.367 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.367 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.FlushSnap (0 ms) 2024-09-16T07:40:44.367 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTwoPoolsPP.FlushTryFlushRaces 2024-09-16T07:40:44.367 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T07:40:44.367 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.367 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T07:40:44.368 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.368 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.FlushTryFlushRaces (0 ms) 2024-09-16T07:40:44.368 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTwoPoolsPP.TryFlushReadRace 2024-09-16T07:40:44.368 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T07:40:44.368 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.368 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T07:40:44.368 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.368 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TryFlushReadRace (0 ms) 2024-09-16T07:40:44.368 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTwoPoolsPP.HitSetRead 2024-09-16T07:40:44.368 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T07:40:44.368 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.368 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T07:40:44.369 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.369 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetRead (0 ms) 2024-09-16T07:40:44.369 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTwoPoolsPP.HitSetWrite 2024-09-16T07:40:44.369 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T07:40:44.369 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.369 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T07:40:44.369 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.369 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetWrite (0 ms) 2024-09-16T07:40:44.369 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTwoPoolsPP.HitSetTrim 2024-09-16T07:40:44.369 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T07:40:44.369 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.369 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T07:40:44.369 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.369 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetTrim (0 ms) 2024-09-16T07:40:44.370 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTwoPoolsPP.PromoteOn2ndRead 2024-09-16T07:40:44.370 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T07:40:44.370 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.370 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T07:40:44.370 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.370 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteOn2ndRead (0 ms) 2024-09-16T07:40:44.370 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTwoPoolsPP.ProxyRead 2024-09-16T07:40:44.370 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T07:40:44.370 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.370 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T07:40:44.370 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.370 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ProxyRead (0 ms) 2024-09-16T07:40:44.370 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTwoPoolsPP.CachePin 2024-09-16T07:40:44.370 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T07:40:44.371 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.371 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T07:40:44.371 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.371 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.CachePin (0 ms) 2024-09-16T07:40:44.371 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTwoPoolsPP.SetRedirectRead 2024-09-16T07:40:44.371 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T07:40:44.371 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.371 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T07:40:44.371 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.371 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.SetRedirectRead (0 ms) 2024-09-16T07:40:44.371 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestPromoteRead 2024-09-16T07:40:44.371 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T07:40:44.371 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.372 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T07:40:44.372 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.372 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestPromoteRead (0 ms) 2024-09-16T07:40:44.372 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestRefRead 2024-09-16T07:40:44.372 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T07:40:44.372 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.372 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T07:40:44.372 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.372 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRefRead (0 ms) 2024-09-16T07:40:44.372 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestUnset 2024-09-16T07:40:44.372 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T07:40:44.372 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.372 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T07:40:44.373 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.373 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestUnset (0 ms) 2024-09-16T07:40:44.373 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestDedupRefRead 2024-09-16T07:40:44.373 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T07:40:44.373 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.373 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T07:40:44.373 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.373 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestDedupRefRead (0 ms) 2024-09-16T07:40:44.373 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount 2024-09-16T07:40:44.373 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T07:40:44.373 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.373 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T07:40:44.373 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.374 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapRefcount (0 ms) 2024-09-16T07:40:44.374 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 2024-09-16T07:40:44.374 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T07:40:44.374 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.374 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T07:40:44.374 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.374 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 (0 ms) 2024-09-16T07:40:44.374 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestTestSnapCreate 2024-09-16T07:40:44.374 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T07:40:44.374 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.374 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T07:40:44.374 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.374 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestTestSnapCreate (0 ms) 2024-09-16T07:40:44.374 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote 2024-09-16T07:40:44.375 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T07:40:44.375 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.375 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T07:40:44.375 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.375 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote (0 ms) 2024-09-16T07:40:44.375 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification 2024-09-16T07:40:44.375 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T07:40:44.375 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.375 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T07:40:44.375 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.375 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification (0 ms) 2024-09-16T07:40:44.375 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestSnapIncCount 2024-09-16T07:40:44.375 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T07:40:44.376 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.376 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T07:40:44.376 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.376 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapIncCount (0 ms) 2024-09-16T07:40:44.376 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestEvict 2024-09-16T07:40:44.376 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T07:40:44.376 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.376 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T07:40:44.376 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.376 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvict (0 ms) 2024-09-16T07:40:44.376 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestEvictPromote 2024-09-16T07:40:44.376 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T07:40:44.376 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.377 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T07:40:44.377 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.377 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvictPromote (0 ms) 2024-09-16T07:40:44.377 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch 2024-09-16T07:40:44.377 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T07:40:44.377 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.377 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T07:40:44.377 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.377 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch (0 ms) 2024-09-16T07:40:44.377 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTwoPoolsPP.DedupFlushRead 2024-09-16T07:40:44.377 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T07:40:44.377 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.377 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T07:40:44.378 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.378 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.DedupFlushRead (0 ms) 2024-09-16T07:40:44.378 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestFlushSnap 2024-09-16T07:40:44.378 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T07:40:44.378 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.378 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T07:40:44.378 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.378 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestFlushSnap (0 ms) 2024-09-16T07:40:44.378 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestFlushDupCount 2024-09-16T07:40:44.378 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T07:40:44.378 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.378 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T07:40:44.378 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.378 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestFlushDupCount (0 ms) 2024-09-16T07:40:44.379 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTwoPoolsPP.TierFlushDuringFlush 2024-09-16T07:40:44.379 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T07:40:44.379 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.379 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T07:40:44.379 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.379 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TierFlushDuringFlush (0 ms) 2024-09-16T07:40:44.379 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestSnapHasChunk 2024-09-16T07:40:44.379 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T07:40:44.379 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.379 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T07:40:44.379 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.379 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapHasChunk (0 ms) 2024-09-16T07:40:44.379 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestRollback 2024-09-16T07:40:44.380 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T07:40:44.380 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.380 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T07:40:44.380 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.380 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRollback (0 ms) 2024-09-16T07:40:44.380 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestRollbackRefcount 2024-09-16T07:40:44.380 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T07:40:44.380 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.380 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T07:40:44.380 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.380 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRollbackRefcount (0 ms) 2024-09-16T07:40:44.380 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestEvictRollback 2024-09-16T07:40:44.380 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T07:40:44.380 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.381 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T07:40:44.381 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.381 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvictRollback (0 ms) 2024-09-16T07:40:44.381 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTwoPoolsPP.PropagateBaseTierError 2024-09-16T07:40:44.381 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T07:40:44.381 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.381 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T07:40:44.381 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.381 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PropagateBaseTierError (0 ms) 2024-09-16T07:40:44.381 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTwoPoolsPP.HelloWriteReturn 2024-09-16T07:40:44.381 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T07:40:44.381 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.381 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T07:40:44.382 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.382 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HelloWriteReturn (0 ms) 2024-09-16T07:40:44.382 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier 2024-09-16T07:40:44.382 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-16T07:40:44.382 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.382 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-16T07:40:44.382 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:44.382 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier (0 ms) 2024-09-16T07:40:45.360 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 48 tests from LibRadosTwoPoolsPP (1 ms total) 2024-09-16T07:40:45.360 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:40:45.360 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 4 tests from LibRadosTierECPP 2024-09-16T07:40:45.360 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:375: Skipped 2024-09-16T07:40:45.360 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:45.360 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTierECPP.Dirty 2024-09-16T07:40:45.360 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T07:40:45.361 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:45.361 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T07:40:45.361 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:45.361 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTierECPP.Dirty (0 ms) 2024-09-16T07:40:45.361 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTierECPP.FlushWriteRaces 2024-09-16T07:40:45.361 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T07:40:45.361 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:45.361 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T07:40:45.361 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:45.361 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTierECPP.FlushWriteRaces (0 ms) 2024-09-16T07:40:45.361 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTierECPP.CallForcesPromote 2024-09-16T07:40:45.362 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T07:40:45.362 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:45.362 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T07:40:45.362 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:45.362 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTierECPP.CallForcesPromote (0 ms) 2024-09-16T07:40:45.362 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTierECPP.HitSetNone 2024-09-16T07:40:45.362 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T07:40:45.362 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:45.362 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T07:40:45.362 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:45.362 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTierECPP.HitSetNone (0 ms) 2024-09-16T07:40:45.362 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:383: Skipped 2024-09-16T07:40:45.362 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:45.362 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 4 tests from LibRadosTierECPP (0 ms total) 2024-09-16T07:40:45.362 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:40:45.363 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 22 tests from LibRadosTwoPoolsECPP 2024-09-16T07:40:45.363 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6267: Skipped 2024-09-16T07:40:45.363 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:45.363 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTwoPoolsECPP.Overlay 2024-09-16T07:40:45.363 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-16T07:40:45.363 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:45.363 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-16T07:40:45.363 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:45.363 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Overlay (0 ms) 2024-09-16T07:40:45.363 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTwoPoolsECPP.Promote 2024-09-16T07:40:45.363 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-16T07:40:45.363 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:45.363 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-16T07:40:45.363 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:45.364 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Promote (0 ms) 2024-09-16T07:40:45.364 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTwoPoolsECPP.PromoteSnap 2024-09-16T07:40:45.364 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-16T07:40:45.364 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:45.364 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-16T07:40:45.364 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:45.364 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteSnap (1 ms) 2024-09-16T07:40:45.364 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace 2024-09-16T07:40:45.364 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-16T07:40:45.364 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:45.364 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-16T07:40:45.364 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:45.364 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace (0 ms) 2024-09-16T07:40:45.365 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTwoPoolsECPP.Whiteout 2024-09-16T07:40:45.365 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-16T07:40:45.365 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:45.365 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-16T07:40:45.365 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:45.365 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Whiteout (0 ms) 2024-09-16T07:40:45.365 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTwoPoolsECPP.Evict 2024-09-16T07:40:45.365 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-16T07:40:45.365 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:45.365 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-16T07:40:45.365 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:45.365 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Evict (0 ms) 2024-09-16T07:40:45.365 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTwoPoolsECPP.EvictSnap 2024-09-16T07:40:45.366 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-16T07:40:45.366 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:45.366 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-16T07:40:45.366 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:45.366 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.EvictSnap (0 ms) 2024-09-16T07:40:45.366 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTwoPoolsECPP.TryFlush 2024-09-16T07:40:45.366 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-16T07:40:45.366 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:45.366 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-16T07:40:45.366 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:45.366 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TryFlush (0 ms) 2024-09-16T07:40:45.366 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTwoPoolsECPP.FailedFlush 2024-09-16T07:40:45.366 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-16T07:40:45.366 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:45.367 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-16T07:40:45.367 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:45.367 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FailedFlush (0 ms) 2024-09-16T07:40:45.367 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTwoPoolsECPP.Flush 2024-09-16T07:40:45.367 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-16T07:40:45.367 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:45.367 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-16T07:40:45.367 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:45.367 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Flush (0 ms) 2024-09-16T07:40:45.367 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTwoPoolsECPP.FlushSnap 2024-09-16T07:40:45.367 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-16T07:40:45.367 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:45.367 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-16T07:40:45.367 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:45.368 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FlushSnap (0 ms) 2024-09-16T07:40:45.368 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTwoPoolsECPP.FlushTryFlushRaces 2024-09-16T07:40:45.368 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-16T07:40:45.368 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:45.368 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-16T07:40:45.368 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:45.368 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FlushTryFlushRaces (0 ms) 2024-09-16T07:40:45.368 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTwoPoolsECPP.TryFlushReadRace 2024-09-16T07:40:45.368 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-16T07:40:45.368 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:45.368 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-16T07:40:45.368 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:45.369 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TryFlushReadRace (0 ms) 2024-09-16T07:40:45.369 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTwoPoolsECPP.HitSetRead 2024-09-16T07:40:45.369 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-16T07:40:45.369 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:45.370 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-16T07:40:45.370 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:45.370 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.HitSetRead (0 ms) 2024-09-16T07:40:45.370 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTwoPoolsECPP.HitSetTrim 2024-09-16T07:40:45.370 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-16T07:40:45.370 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:45.370 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-16T07:40:45.370 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:45.370 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.HitSetTrim (0 ms) 2024-09-16T07:40:45.370 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTwoPoolsECPP.PromoteOn2ndRead 2024-09-16T07:40:45.371 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-16T07:40:45.371 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:45.371 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-16T07:40:45.371 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:45.371 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteOn2ndRead (0 ms) 2024-09-16T07:40:45.371 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTwoPoolsECPP.ProxyRead 2024-09-16T07:40:45.371 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-16T07:40:45.371 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:45.371 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-16T07:40:45.371 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:45.371 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.ProxyRead (0 ms) 2024-09-16T07:40:45.371 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTwoPoolsECPP.CachePin 2024-09-16T07:40:45.371 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-16T07:40:45.371 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:45.372 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-16T07:40:45.372 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:45.372 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.CachePin (0 ms) 2024-09-16T07:40:45.372 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTwoPoolsECPP.SetRedirectRead 2024-09-16T07:40:45.372 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-16T07:40:45.372 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:45.372 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-16T07:40:45.372 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:45.372 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.SetRedirectRead (0 ms) 2024-09-16T07:40:45.372 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTwoPoolsECPP.SetChunkRead 2024-09-16T07:40:45.372 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-16T07:40:45.372 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:45.372 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-16T07:40:45.373 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:45.373 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.SetChunkRead (0 ms) 2024-09-16T07:40:45.373 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTwoPoolsECPP.ManifestPromoteRead 2024-09-16T07:40:45.373 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-16T07:40:45.373 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:45.373 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-16T07:40:45.373 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:45.373 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.ManifestPromoteRead (0 ms) 2024-09-16T07:40:45.373 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosTwoPoolsECPP.TrySetDedupTier 2024-09-16T07:40:45.373 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-16T07:40:45.373 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:45.373 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-16T07:40:45.374 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:45.374 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TrySetDedupTier (0 ms) 2024-09-16T07:40:45.374 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/tier_cxx.cc:6272: Skipped 2024-09-16T07:40:45.374 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:40:45.374 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 22 tests from LibRadosTwoPoolsECPP (1 ms total) 2024-09-16T07:40:45.374 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:40:45.374 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment tear-down 2024-09-16T07:40:45.374 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] 77 tests from 4 test suites ran. (5865 ms total) 2024-09-16T07:40:45.374 INFO:tasks.workunit.client.0.smithi121.stdout:[ PASSED ] 0 tests. 2024-09-16T07:40:45.374 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] 77 tests, listed below: 2024-09-16T07:40:45.374 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTierPP.Dirty 2024-09-16T07:40:45.374 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTierPP.FlushWriteRaces 2024-09-16T07:40:45.374 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTierPP.HitSetNone 2024-09-16T07:40:45.374 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Overlay 2024-09-16T07:40:45.375 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Promote 2024-09-16T07:40:45.375 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnap 2024-09-16T07:40:45.375 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnapScrub 2024-09-16T07:40:45.375 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnapTrimRace 2024-09-16T07:40:45.375 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Whiteout 2024-09-16T07:40:45.375 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate 2024-09-16T07:40:45.375 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Evict 2024-09-16T07:40:45.375 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnap 2024-09-16T07:40:45.375 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnap2 2024-09-16T07:40:45.375 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ListSnap 2024-09-16T07:40:45.375 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace 2024-09-16T07:40:45.375 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TryFlush 2024-09-16T07:40:45.375 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Flush 2024-09-16T07:40:45.375 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.FlushSnap 2024-09-16T07:40:45.376 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.FlushTryFlushRaces 2024-09-16T07:40:45.376 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TryFlushReadRace 2024-09-16T07:40:45.376 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetRead 2024-09-16T07:40:45.376 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetWrite 2024-09-16T07:40:45.376 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetTrim 2024-09-16T07:40:45.376 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteOn2ndRead 2024-09-16T07:40:45.376 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ProxyRead 2024-09-16T07:40:45.376 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.CachePin 2024-09-16T07:40:45.376 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.SetRedirectRead 2024-09-16T07:40:45.376 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestPromoteRead 2024-09-16T07:40:45.376 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRefRead 2024-09-16T07:40:45.376 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestUnset 2024-09-16T07:40:45.376 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestDedupRefRead 2024-09-16T07:40:45.377 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapRefcount 2024-09-16T07:40:45.377 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 2024-09-16T07:40:45.377 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestTestSnapCreate 2024-09-16T07:40:45.377 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote 2024-09-16T07:40:45.377 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification 2024-09-16T07:40:45.377 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapIncCount 2024-09-16T07:40:45.377 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvict 2024-09-16T07:40:45.377 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvictPromote 2024-09-16T07:40:45.377 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch 2024-09-16T07:40:45.377 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.DedupFlushRead 2024-09-16T07:40:45.377 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestFlushSnap 2024-09-16T07:40:45.377 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestFlushDupCount 2024-09-16T07:40:45.377 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TierFlushDuringFlush 2024-09-16T07:40:45.377 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapHasChunk 2024-09-16T07:40:45.378 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRollback 2024-09-16T07:40:45.378 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRollbackRefcount 2024-09-16T07:40:45.378 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvictRollback 2024-09-16T07:40:45.378 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PropagateBaseTierError 2024-09-16T07:40:45.378 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HelloWriteReturn 2024-09-16T07:40:45.378 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier 2024-09-16T07:40:45.378 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTierECPP.Dirty 2024-09-16T07:40:45.378 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTierECPP.FlushWriteRaces 2024-09-16T07:40:45.378 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTierECPP.CallForcesPromote 2024-09-16T07:40:45.378 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTierECPP.HitSetNone 2024-09-16T07:40:45.378 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Overlay 2024-09-16T07:40:45.378 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Promote 2024-09-16T07:40:45.378 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteSnap 2024-09-16T07:40:45.378 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace 2024-09-16T07:40:45.379 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Whiteout 2024-09-16T07:40:45.379 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Evict 2024-09-16T07:40:45.379 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.EvictSnap 2024-09-16T07:40:45.379 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TryFlush 2024-09-16T07:40:45.379 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FailedFlush 2024-09-16T07:40:45.379 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Flush 2024-09-16T07:40:45.379 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FlushSnap 2024-09-16T07:40:45.379 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FlushTryFlushRaces 2024-09-16T07:40:45.379 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TryFlushReadRace 2024-09-16T07:40:45.379 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.HitSetRead 2024-09-16T07:40:45.379 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.HitSetTrim 2024-09-16T07:40:45.379 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteOn2ndRead 2024-09-16T07:40:45.379 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.ProxyRead 2024-09-16T07:40:45.379 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.CachePin 2024-09-16T07:40:45.379 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.SetRedirectRead 2024-09-16T07:40:45.380 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.SetChunkRead 2024-09-16T07:40:45.380 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.ManifestPromoteRead 2024-09-16T07:40:45.380 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TrySetDedupTier 2024-09-16T07:40:45.380 INFO:tasks.workunit.client.0.smithi121.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T07:40:45.380 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T07:40:45.380 INFO:tasks.workunit.client.0.smithi121.stderr:+ ceph_test_rados_api_pool 2024-09-16T07:40:45.381 INFO:tasks.workunit.client.0.smithi121.stdout:Running main() from gmock_main.cc 2024-09-16T07:40:45.381 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-16T07:40:45.381 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment set-up. 2024-09-16T07:40:45.381 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 9 tests from LibRadosPools 2024-09-16T07:40:45.381 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosPools.PoolList 2024-09-16T07:40:48.367 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosPools.PoolList (2987 ms) 2024-09-16T07:40:48.367 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosPools.PoolLookup 2024-09-16T07:40:51.403 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosPools.PoolLookup (3023 ms) 2024-09-16T07:40:51.403 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosPools.PoolLookup2 2024-09-16T07:40:54.354 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosPools.PoolLookup2 (2963 ms) 2024-09-16T07:40:54.354 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosPools.PoolLookupOtherInstance 2024-09-16T07:40:57.371 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosPools.PoolLookupOtherInstance (3018 ms) 2024-09-16T07:40:57.372 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosPools.PoolReverseLookupOtherInstance 2024-09-16T07:41:00.381 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosPools.PoolReverseLookupOtherInstance (3010 ms) 2024-09-16T07:41:00.381 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosPools.PoolDelete 2024-09-16T07:41:05.362 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosPools.PoolDelete (4980 ms) 2024-09-16T07:41:05.362 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosPools.PoolCreateDelete 2024-09-16T07:41:10.394 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosPools.PoolCreateDelete (5032 ms) 2024-09-16T07:41:10.394 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosPools.PoolCreateWithCrushRule 2024-09-16T07:41:15.362 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosPools.PoolCreateWithCrushRule (4968 ms) 2024-09-16T07:41:15.362 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosPools.PoolGetBaseTier 2024-09-16T07:41:15.362 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/pool.cc:139: Skipped 2024-09-16T07:41:15.363 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:41:15.363 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosPools.PoolGetBaseTier (0 ms) 2024-09-16T07:41:15.363 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 9 tests from LibRadosPools (29981 ms total) 2024-09-16T07:41:15.363 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:41:15.363 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment tear-down 2024-09-16T07:41:15.363 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] 9 tests from 1 test suite ran. (29981 ms total) 2024-09-16T07:41:15.363 INFO:tasks.workunit.client.0.smithi121.stdout:[ PASSED ] 8 tests. 2024-09-16T07:41:15.363 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] 1 test, listed below: 2024-09-16T07:41:15.363 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosPools.PoolGetBaseTier 2024-09-16T07:41:15.365 INFO:tasks.workunit.client.0.smithi121.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T07:41:15.366 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T07:41:15.366 INFO:tasks.workunit.client.0.smithi121.stderr:+ ceph_test_rados_api_snapshots 2024-09-16T07:41:15.393 INFO:tasks.workunit.client.0.smithi121.stdout:Running main() from gmock_main.cc 2024-09-16T07:41:15.393 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] Running 13 tests from 4 test suites. 2024-09-16T07:41:15.393 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment set-up. 2024-09-16T07:41:15.393 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 4 tests from LibRadosSnapshots 2024-09-16T07:41:17.377 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosSnapshots.SnapList 2024-09-16T07:41:19.384 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosSnapshots.SnapList (2007 ms) 2024-09-16T07:41:19.384 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosSnapshots.SnapRemove 2024-09-16T07:41:21.396 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosSnapshots.SnapRemove (2011 ms) 2024-09-16T07:41:21.396 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosSnapshots.Rollback 2024-09-16T07:41:23.403 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosSnapshots.Rollback (2008 ms) 2024-09-16T07:41:23.404 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosSnapshots.SnapGetName 2024-09-16T07:41:25.406 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosSnapshots.SnapGetName (2003 ms) 2024-09-16T07:41:26.408 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 4 tests from LibRadosSnapshots (8029 ms total) 2024-09-16T07:41:26.409 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:41:26.409 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 3 tests from LibRadosSnapshotsSelfManaged 2024-09-16T07:41:28.433 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosSnapshotsSelfManaged.Snap 2024-09-16T07:41:32.422 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosSnapshotsSelfManaged.Snap (3989 ms) 2024-09-16T07:41:32.423 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosSnapshotsSelfManaged.Rollback 2024-09-16T07:41:36.435 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosSnapshotsSelfManaged.Rollback (4013 ms) 2024-09-16T07:41:36.435 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosSnapshotsSelfManaged.FutureSnapRollback 2024-09-16T07:41:41.459 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosSnapshotsSelfManaged.FutureSnapRollback (5024 ms) 2024-09-16T07:41:42.364 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 3 tests from LibRadosSnapshotsSelfManaged (13026 ms total) 2024-09-16T07:41:42.365 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:41:42.365 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 4 tests from LibRadosSnapshotsEC 2024-09-16T07:41:42.365 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:168: Skipped 2024-09-16T07:41:42.365 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:41:42.365 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosSnapshotsEC.SnapList 2024-09-16T07:41:42.365 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T07:41:42.365 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:41:42.365 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T07:41:42.365 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:41:42.365 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapList (0 ms) 2024-09-16T07:41:42.365 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosSnapshotsEC.SnapRemove 2024-09-16T07:41:42.365 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T07:41:42.366 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:41:42.366 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T07:41:42.366 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:41:42.366 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapRemove (0 ms) 2024-09-16T07:41:42.366 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosSnapshotsEC.Rollback 2024-09-16T07:41:42.366 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T07:41:42.366 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:41:42.366 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T07:41:42.366 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:41:42.366 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosSnapshotsEC.Rollback (0 ms) 2024-09-16T07:41:42.366 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosSnapshotsEC.SnapGetName 2024-09-16T07:41:42.366 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T07:41:42.366 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:41:42.368 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T07:41:42.368 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:41:42.368 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapGetName (0 ms) 2024-09-16T07:41:42.368 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:176: Skipped 2024-09-16T07:41:42.368 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:41:42.368 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 4 tests from LibRadosSnapshotsEC (0 ms total) 2024-09-16T07:41:42.368 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:41:42.368 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 2 tests from LibRadosSnapshotsSelfManagedEC 2024-09-16T07:41:42.368 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:168: Skipped 2024-09-16T07:41:42.369 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:41:42.369 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosSnapshotsSelfManagedEC.Snap 2024-09-16T07:41:42.369 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T07:41:42.369 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:41:42.369 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T07:41:42.369 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:41:42.369 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedEC.Snap (0 ms) 2024-09-16T07:41:42.369 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosSnapshotsSelfManagedEC.Rollback 2024-09-16T07:41:42.369 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T07:41:42.369 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:41:42.369 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T07:41:42.369 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:41:42.369 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedEC.Rollback (0 ms) 2024-09-16T07:41:42.370 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:176: Skipped 2024-09-16T07:41:42.370 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:41:42.370 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 2 tests from LibRadosSnapshotsSelfManagedEC (0 ms total) 2024-09-16T07:41:42.370 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:41:42.370 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment tear-down 2024-09-16T07:41:42.370 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] 13 tests from 4 test suites ran. (26969 ms total) 2024-09-16T07:41:42.370 INFO:tasks.workunit.client.0.smithi121.stdout:[ PASSED ] 7 tests. 2024-09-16T07:41:42.370 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] 6 tests, listed below: 2024-09-16T07:41:42.370 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapList 2024-09-16T07:41:42.370 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapRemove 2024-09-16T07:41:42.370 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosSnapshotsEC.Rollback 2024-09-16T07:41:42.370 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapGetName 2024-09-16T07:41:42.370 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedEC.Snap 2024-09-16T07:41:42.371 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedEC.Rollback 2024-09-16T07:41:42.371 INFO:tasks.workunit.client.0.smithi121.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T07:41:42.371 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T07:41:42.371 INFO:tasks.workunit.client.0.smithi121.stderr:+ ceph_test_rados_api_snapshots_pp 2024-09-16T07:41:42.388 INFO:tasks.workunit.client.0.smithi121.stdout:Running main() from gmock_main.cc 2024-09-16T07:41:42.388 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] Running 21 tests from 5 test suites. 2024-09-16T07:41:42.388 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment set-up. 2024-09-16T07:41:42.388 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 5 tests from LibRadosSnapshotsPP 2024-09-16T07:41:42.388 INFO:tasks.workunit.client.0.smithi121.stdout:seed 93299 2024-09-16T07:41:44.410 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosSnapshotsPP.SnapListPP 2024-09-16T07:41:46.417 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosSnapshotsPP.SnapListPP (2007 ms) 2024-09-16T07:41:46.417 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosSnapshotsPP.SnapRemovePP 2024-09-16T07:41:48.427 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosSnapshotsPP.SnapRemovePP (2010 ms) 2024-09-16T07:41:48.427 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosSnapshotsPP.RollbackPP 2024-09-16T07:41:50.436 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosSnapshotsPP.RollbackPP (2009 ms) 2024-09-16T07:41:50.436 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosSnapshotsPP.SnapGetNamePP 2024-09-16T07:41:52.366 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosSnapshotsPP.SnapGetNamePP (1929 ms) 2024-09-16T07:41:52.366 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosSnapshotsPP.SnapCreateRemovePP 2024-09-16T07:41:56.381 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosSnapshotsPP.SnapCreateRemovePP (4015 ms) 2024-09-16T07:41:57.385 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 5 tests from LibRadosSnapshotsPP (11970 ms total) 2024-09-16T07:41:57.386 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:41:57.386 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 7 tests from LibRadosSnapshotsSelfManagedPP 2024-09-16T07:41:59.408 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.SnapPP 2024-09-16T07:42:03.419 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.SnapPP (4011 ms) 2024-09-16T07:42:03.420 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.RollbackPP 2024-09-16T07:42:07.432 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.RollbackPP (4013 ms) 2024-09-16T07:42:07.432 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP 2024-09-16T07:42:13.373 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP (5941 ms) 2024-09-16T07:42:13.374 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.Bug11677 2024-09-16T07:42:17.383 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.Bug11677 (4010 ms) 2024-09-16T07:42:17.383 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.OrderSnap 2024-09-16T07:42:19.467 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.OrderSnap (2083 ms) 2024-09-16T07:42:19.467 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2024-09-16T07:42:19.467 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/snapshots_cxx.cc:460: Skipped 2024-09-16T07:42:19.467 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:42:19.467 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback (0 ms) 2024-09-16T07:42:19.467 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap 2024-09-16T07:42:21.418 INFO:tasks.workunit.client.0.smithi121.stdout:deleting snap 14 in pool LibRadosSnapshotsSelfManagedPP_smithi121-93299-7 2024-09-16T07:42:22.371 INFO:tasks.workunit.client.0.smithi121.stdout:waiting for snaps to purge 2024-09-16T07:42:37.398 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap (17932 ms) 2024-09-16T07:42:37.434 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 7 tests from LibRadosSnapshotsSelfManagedPP (37990 ms total) 2024-09-16T07:42:37.435 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:42:37.435 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode 2024-09-16T07:42:37.435 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected 2024-09-16T07:42:37.442 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected (8 ms) 2024-09-16T07:42:37.442 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance 2024-09-16T07:42:42.417 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance (4973 ms) 2024-09-16T07:42:42.417 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode (4981 ms total) 2024-09-16T07:42:42.418 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:42:42.418 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 4 tests from LibRadosSnapshotsECPP 2024-09-16T07:42:42.418 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:375: Skipped 2024-09-16T07:42:42.418 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:42:42.418 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosSnapshotsECPP.SnapListPP 2024-09-16T07:42:42.418 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T07:42:42.418 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:42:42.418 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T07:42:42.418 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:42:42.418 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapListPP (0 ms) 2024-09-16T07:42:42.418 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosSnapshotsECPP.SnapRemovePP 2024-09-16T07:42:42.419 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T07:42:42.419 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:42:42.419 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T07:42:42.419 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:42:42.419 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapRemovePP (0 ms) 2024-09-16T07:42:42.419 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosSnapshotsECPP.RollbackPP 2024-09-16T07:42:42.419 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T07:42:42.419 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:42:42.419 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T07:42:42.419 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:42:42.419 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.RollbackPP (0 ms) 2024-09-16T07:42:42.419 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosSnapshotsECPP.SnapGetNamePP 2024-09-16T07:42:42.420 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T07:42:42.420 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:42:42.420 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T07:42:42.420 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:42:42.420 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapGetNamePP (0 ms) 2024-09-16T07:42:42.420 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:383: Skipped 2024-09-16T07:42:42.420 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:42:42.420 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 4 tests from LibRadosSnapshotsECPP (0 ms total) 2024-09-16T07:42:42.420 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:42:42.420 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 3 tests from LibRadosSnapshotsSelfManagedECPP 2024-09-16T07:42:42.420 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:375: Skipped 2024-09-16T07:42:42.420 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:42:42.420 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosSnapshotsSelfManagedECPP.SnapPP 2024-09-16T07:42:42.421 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T07:42:42.421 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:42:42.421 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T07:42:42.421 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:42:42.421 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.SnapPP (0 ms) 2024-09-16T07:42:42.421 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosSnapshotsSelfManagedECPP.RollbackPP 2024-09-16T07:42:42.421 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T07:42:42.421 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:42:42.421 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T07:42:42.421 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:42:42.421 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.RollbackPP (0 ms) 2024-09-16T07:42:42.421 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosSnapshotsSelfManagedECPP.Bug11677 2024-09-16T07:42:42.421 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T07:42:42.421 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:42:42.422 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T07:42:42.422 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:42:42.422 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.Bug11677 (0 ms) 2024-09-16T07:42:42.422 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:383: Skipped 2024-09-16T07:42:42.422 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:42:42.422 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 3 tests from LibRadosSnapshotsSelfManagedECPP (0 ms total) 2024-09-16T07:42:42.422 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:42:42.422 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment tear-down 2024-09-16T07:42:42.422 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] 21 tests from 5 test suites ran. (60028 ms total) 2024-09-16T07:42:42.422 INFO:tasks.workunit.client.0.smithi121.stdout:[ PASSED ] 13 tests. 2024-09-16T07:42:42.422 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] 8 tests, listed below: 2024-09-16T07:42:42.422 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2024-09-16T07:42:42.422 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapListPP 2024-09-16T07:42:42.422 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapRemovePP 2024-09-16T07:42:42.423 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.RollbackPP 2024-09-16T07:42:42.423 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapGetNamePP 2024-09-16T07:42:42.423 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.SnapPP 2024-09-16T07:42:42.423 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.RollbackPP 2024-09-16T07:42:42.423 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.Bug11677 2024-09-16T07:42:42.424 INFO:tasks.workunit.client.0.smithi121.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T07:42:42.424 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T07:42:42.424 INFO:tasks.workunit.client.0.smithi121.stderr:+ ceph_test_rados_api_stat 2024-09-16T07:42:42.448 INFO:tasks.workunit.client.0.smithi121.stdout:Running main() from gmock_main.cc 2024-09-16T07:42:42.448 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] Running 9 tests from 2 test suites. 2024-09-16T07:42:42.448 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment set-up. 2024-09-16T07:42:42.449 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 5 tests from LibRadosStat 2024-09-16T07:42:44.458 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosStat.Stat 2024-09-16T07:42:44.738 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosStat.Stat (280 ms) 2024-09-16T07:42:44.739 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosStat.Stat2 2024-09-16T07:42:44.770 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosStat.Stat2 (32 ms) 2024-09-16T07:42:44.770 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosStat.StatNS 2024-09-16T07:42:44.833 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosStat.StatNS (63 ms) 2024-09-16T07:42:44.834 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosStat.ClusterStat 2024-09-16T07:42:44.834 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosStat.ClusterStat (1 ms) 2024-09-16T07:42:44.834 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosStat.PoolStat 2024-09-16T07:42:44.847 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosStat.PoolStat (13 ms) 2024-09-16T07:42:45.474 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 5 tests from LibRadosStat (389 ms total) 2024-09-16T07:42:45.474 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:42:45.474 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 4 tests from LibRadosStatEC 2024-09-16T07:42:45.474 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:168: Skipped 2024-09-16T07:42:45.474 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:42:45.474 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosStatEC.Stat 2024-09-16T07:42:45.474 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T07:42:45.474 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:42:45.474 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T07:42:45.475 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:42:45.475 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosStatEC.Stat (0 ms) 2024-09-16T07:42:45.475 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosStatEC.StatNS 2024-09-16T07:42:45.475 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T07:42:45.475 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:42:45.475 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T07:42:45.475 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:42:45.475 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosStatEC.StatNS (0 ms) 2024-09-16T07:42:45.475 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosStatEC.ClusterStat 2024-09-16T07:42:45.475 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T07:42:45.475 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:42:45.475 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T07:42:45.475 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:42:45.475 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosStatEC.ClusterStat (0 ms) 2024-09-16T07:42:45.476 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosStatEC.PoolStat 2024-09-16T07:42:45.476 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T07:42:45.476 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:42:45.476 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T07:42:45.476 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:42:45.476 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosStatEC.PoolStat (0 ms) 2024-09-16T07:42:45.476 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:176: Skipped 2024-09-16T07:42:45.476 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:42:45.476 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 4 tests from LibRadosStatEC (1 ms total) 2024-09-16T07:42:45.476 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:42:45.476 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment tear-down 2024-09-16T07:42:45.477 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] 9 tests from 2 test suites ran. (3027 ms total) 2024-09-16T07:42:45.477 INFO:tasks.workunit.client.0.smithi121.stdout:[ PASSED ] 5 tests. 2024-09-16T07:42:45.477 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] 4 tests, listed below: 2024-09-16T07:42:45.477 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosStatEC.Stat 2024-09-16T07:42:45.477 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosStatEC.StatNS 2024-09-16T07:42:45.477 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosStatEC.ClusterStat 2024-09-16T07:42:45.477 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosStatEC.PoolStat 2024-09-16T07:42:45.478 INFO:tasks.workunit.client.0.smithi121.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T07:42:45.478 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T07:42:45.478 INFO:tasks.workunit.client.0.smithi121.stderr:+ ceph_test_rados_api_stat_pp 2024-09-16T07:42:45.497 INFO:tasks.workunit.client.0.smithi121.stdout:Running main() from gmock_main.cc 2024-09-16T07:42:45.498 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] Running 9 tests from 2 test suites. 2024-09-16T07:42:45.498 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment set-up. 2024-09-16T07:42:45.498 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 5 tests from LibRadosStatPP 2024-09-16T07:42:45.498 INFO:tasks.workunit.client.0.smithi121.stdout:seed 93434 2024-09-16T07:42:47.474 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosStatPP.StatPP 2024-09-16T07:42:47.761 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosStatPP.StatPP (286 ms) 2024-09-16T07:42:47.762 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosStatPP.Stat2Mtime2PP 2024-09-16T07:42:47.792 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosStatPP.Stat2Mtime2PP (32 ms) 2024-09-16T07:42:47.793 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosStatPP.ClusterStatPP 2024-09-16T07:42:47.793 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosStatPP.ClusterStatPP (1 ms) 2024-09-16T07:42:47.793 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosStatPP.PoolStatPP 2024-09-16T07:42:47.806 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosStatPP.PoolStatPP (13 ms) 2024-09-16T07:42:47.806 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosStatPP.StatPPNS 2024-09-16T07:42:47.865 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosStatPP.StatPPNS (59 ms) 2024-09-16T07:42:48.495 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 5 tests from LibRadosStatPP (391 ms total) 2024-09-16T07:42:48.495 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:42:48.495 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 4 tests from LibRadosStatECPP 2024-09-16T07:42:48.495 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:375: Skipped 2024-09-16T07:42:48.495 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:42:48.495 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosStatECPP.StatPP 2024-09-16T07:42:48.495 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T07:42:48.495 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:42:48.496 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T07:42:48.496 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:42:48.496 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosStatECPP.StatPP (0 ms) 2024-09-16T07:42:48.496 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosStatECPP.ClusterStatPP 2024-09-16T07:42:48.496 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T07:42:48.496 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:42:48.496 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T07:42:48.496 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:42:48.496 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosStatECPP.ClusterStatPP (0 ms) 2024-09-16T07:42:48.496 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosStatECPP.PoolStatPP 2024-09-16T07:42:48.496 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T07:42:48.496 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:42:48.496 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T07:42:48.497 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:42:48.497 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosStatECPP.PoolStatPP (0 ms) 2024-09-16T07:42:48.497 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosStatECPP.StatPPNS 2024-09-16T07:42:48.497 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T07:42:48.497 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:42:48.497 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T07:42:48.497 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:42:48.497 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosStatECPP.StatPPNS (0 ms) 2024-09-16T07:42:48.497 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:383: Skipped 2024-09-16T07:42:48.497 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:42:48.497 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 4 tests from LibRadosStatECPP (0 ms total) 2024-09-16T07:42:48.497 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:42:48.497 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment tear-down 2024-09-16T07:42:48.498 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] 9 tests from 2 test suites ran. (2996 ms total) 2024-09-16T07:42:48.498 INFO:tasks.workunit.client.0.smithi121.stdout:[ PASSED ] 5 tests. 2024-09-16T07:42:48.498 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] 4 tests, listed below: 2024-09-16T07:42:48.498 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosStatECPP.StatPP 2024-09-16T07:42:48.498 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosStatECPP.ClusterStatPP 2024-09-16T07:42:48.498 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosStatECPP.PoolStatPP 2024-09-16T07:42:48.498 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosStatECPP.StatPPNS 2024-09-16T07:42:48.498 INFO:tasks.workunit.client.0.smithi121.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T07:42:48.499 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T07:42:48.499 INFO:tasks.workunit.client.0.smithi121.stderr:+ ceph_test_rados_api_watch_notify 2024-09-16T07:42:48.518 INFO:tasks.workunit.client.0.smithi121.stdout:Running main() from gmock_main.cc 2024-09-16T07:42:48.519 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] Running 11 tests from 2 test suites. 2024-09-16T07:42:48.519 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment set-up. 2024-09-16T07:42:48.519 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 10 tests from LibRadosWatchNotify 2024-09-16T07:42:50.510 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosWatchNotify.WatchNotify 2024-09-16T07:42:50.801 INFO:tasks.workunit.client.0.smithi121.stdout:watch_notify_test_cb 2024-09-16T07:42:50.829 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosWatchNotify.WatchNotify (319 ms) 2024-09-16T07:42:50.829 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosWatchNotify.Watch2Delete 2024-09-16T07:42:50.872 INFO:tasks.workunit.client.0.smithi121.stdout:waiting up to 300 for disconnect notification ... 2024-09-16T07:42:53.578 INFO:tasks.workunit.client.0.smithi121.stdout:watch_notify2_test_errcb cookie 10502016 err -107 2024-09-16T07:42:53.883 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosWatchNotify.Watch2Delete (3054 ms) 2024-09-16T07:42:53.883 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosWatchNotify.AioWatchDelete 2024-09-16T07:42:53.924 INFO:tasks.workunit.client.0.smithi121.stdout:waiting up to 300 for disconnect notification ... 2024-09-16T07:42:58.579 INFO:tasks.workunit.client.0.smithi121.stdout:watch_notify2_test_errcb cookie 10503280 err -107 2024-09-16T07:42:58.933 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosWatchNotify.AioWatchDelete (5050 ms) 2024-09-16T07:42:58.934 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosWatchNotify.WatchNotify2 2024-09-16T07:42:58.967 INFO:tasks.workunit.client.0.smithi121.stdout:watch_notify2_test_cb from 15522 notify_id 1743756722176 cookie 10520944 2024-09-16T07:42:58.988 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosWatchNotify.WatchNotify2 (55 ms) 2024-09-16T07:42:58.988 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosWatchNotify.AioWatchNotify2 2024-09-16T07:42:59.020 INFO:tasks.workunit.client.0.smithi121.stdout:watch_notify2_test_cb from 15522 notify_id 1743756722177 cookie 10520944 2024-09-16T07:42:59.042 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosWatchNotify.AioWatchNotify2 (54 ms) 2024-09-16T07:42:59.042 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosWatchNotify.AioNotify 2024-09-16T07:42:59.075 INFO:tasks.workunit.client.0.smithi121.stdout:watch_notify2_test_cb from 15522 notify_id 1743756722178 cookie 10527312 2024-09-16T07:42:59.097 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosWatchNotify.AioNotify (54 ms) 2024-09-16T07:42:59.097 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosWatchNotify.WatchNotify2Multi 2024-09-16T07:42:59.138 INFO:tasks.workunit.client.0.smithi121.stdout:watch_notify2_test_cb from 15522 notify_id 1743756722177 cookie 10520944 2024-09-16T07:42:59.139 INFO:tasks.workunit.client.0.smithi121.stdout:watch_notify2_test_cb from 15522 notify_id 1743756722177 cookie 10527312 2024-09-16T07:42:59.171 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosWatchNotify.WatchNotify2Multi (73 ms) 2024-09-16T07:42:59.171 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosWatchNotify.WatchNotify2Timeout 2024-09-16T07:42:59.205 INFO:tasks.workunit.client.0.smithi121.stdout:watch_notify2_test_cb from 15522 notify_id 1743756722176 cookie 10520944 2024-09-16T07:43:02.206 INFO:tasks.workunit.client.0.smithi121.stdout:watch_notify2_test_cb from 15522 notify_id 1743756722177 cookie 10520944 2024-09-16T07:43:02.232 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosWatchNotify.WatchNotify2Timeout (3062 ms) 2024-09-16T07:43:02.232 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosWatchNotify.Watch3Timeout 2024-09-16T07:43:02.261 INFO:tasks.workunit.client.0.smithi121.stdout:waiting up to 1024 for osd to time us out ... 2024-09-16T07:43:06.271 INFO:tasks.workunit.client.0.smithi121.stdout:watch_notify2_test_errcb cookie 10520944 err -107 2024-09-16T07:43:07.295 INFO:tasks.workunit.client.0.smithi121.stdout:watch_notify2_test_cb from 15522 notify_id 1743756722179 cookie 10520944 2024-09-16T07:43:07.313 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosWatchNotify.Watch3Timeout (5081 ms) 2024-09-16T07:43:07.313 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosWatchNotify.AioWatchDelete2 2024-09-16T07:43:07.356 INFO:tasks.workunit.client.0.smithi121.stdout:waiting up to 30 for disconnect notification ... 2024-09-16T07:43:08.581 INFO:tasks.workunit.client.0.smithi121.stdout:watch_notify2_test_errcb cookie 10529872 err -107 2024-09-16T07:43:09.366 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosWatchNotify.AioWatchDelete2 (2053 ms) 2024-09-16T07:43:09.531 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 10 tests from LibRadosWatchNotify (18856 ms total) 2024-09-16T07:43:09.531 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:43:09.531 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 1 test from LibRadosWatchNotifyEC 2024-09-16T07:43:09.531 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:168: Skipped 2024-09-16T07:43:09.531 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:43:09.531 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosWatchNotifyEC.WatchNotify 2024-09-16T07:43:09.531 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:182: Skipped 2024-09-16T07:43:09.532 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:43:09.532 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:196: Skipped 2024-09-16T07:43:09.532 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:43:09.532 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosWatchNotifyEC.WatchNotify (0 ms) 2024-09-16T07:43:09.532 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/TestCase.cc:176: Skipped 2024-09-16T07:43:09.532 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:43:09.532 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 1 test from LibRadosWatchNotifyEC (0 ms total) 2024-09-16T07:43:09.532 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:43:09.532 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment tear-down 2024-09-16T07:43:09.532 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] 11 tests from 2 test suites ran. (21012 ms total) 2024-09-16T07:43:09.532 INFO:tasks.workunit.client.0.smithi121.stdout:[ PASSED ] 10 tests. 2024-09-16T07:43:09.532 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] 1 test, listed below: 2024-09-16T07:43:09.532 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosWatchNotifyEC.WatchNotify 2024-09-16T07:43:09.533 INFO:tasks.workunit.client.0.smithi121.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T07:43:09.534 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T07:43:09.534 INFO:tasks.workunit.client.0.smithi121.stderr:+ ceph_test_rados_api_watch_notify_pp 2024-09-16T07:43:09.555 INFO:tasks.workunit.client.0.smithi121.stdout:Running main() from gmock_main.cc 2024-09-16T07:43:09.555 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] Running 16 tests from 2 test suites. 2024-09-16T07:43:09.555 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment set-up. 2024-09-16T07:43:09.556 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 2 tests from LibRadosWatchNotifyECPP 2024-09-16T07:43:09.556 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:375: Skipped 2024-09-16T07:43:09.556 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:43:09.556 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosWatchNotifyECPP.WatchNotify 2024-09-16T07:43:09.556 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T07:43:09.556 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:43:09.556 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T07:43:09.556 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:43:09.556 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosWatchNotifyECPP.WatchNotify (0 ms) 2024-09-16T07:43:09.556 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosWatchNotifyECPP.WatchNotifyTimeout 2024-09-16T07:43:09.556 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-16T07:43:09.556 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:43:09.556 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-16T07:43:09.556 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:43:09.557 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosWatchNotifyECPP.WatchNotifyTimeout (0 ms) 2024-09-16T07:43:09.557 INFO:tasks.workunit.client.0.smithi121.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4879-g81fedcb3/rpm/el9/BUILD/ceph-19.3.0-4879-g81fedcb3/src/test/librados/testcase_cxx.cc:383: Skipped 2024-09-16T07:43:09.557 INFO:tasks.workunit.client.0.smithi121.stdout:Not supported by crimson yet. Skipped 2024-09-16T07:43:09.557 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 2 tests from LibRadosWatchNotifyECPP (0 ms total) 2024-09-16T07:43:09.557 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:43:09.557 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP 2024-09-16T07:43:11.538 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 2024-09-16T07:43:11.852 INFO:tasks.workunit.client.0.smithi121.stdout:notify 2024-09-16T07:43:11.868 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 (329 ms) 2024-09-16T07:43:11.868 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 2024-09-16T07:43:11.902 INFO:tasks.workunit.client.0.smithi121.stdout:notify 2024-09-16T07:43:11.917 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 (50 ms) 2024-09-16T07:43:11.918 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 2024-09-16T07:43:11.959 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 (41 ms) 2024-09-16T07:43:11.959 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 2024-09-16T07:43:11.996 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 (38 ms) 2024-09-16T07:43:11.997 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 2024-09-16T07:43:12.031 INFO:tasks.workunit.client.0.smithi121.stdout:handle_notify cookie 29706992 notify_id 1756641624070 notifier_gid 15525 2024-09-16T07:43:12.047 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 (51 ms) 2024-09-16T07:43:12.047 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 2024-09-16T07:43:12.078 INFO:tasks.workunit.client.0.smithi121.stdout:handle_notify cookie 29706992 notify_id 1756641624067 notifier_gid 15525 2024-09-16T07:43:12.094 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 (47 ms) 2024-09-16T07:43:12.094 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 2024-09-16T07:43:12.128 INFO:tasks.workunit.client.0.smithi121.stdout:handle_notify cookie 29706992 notify_id 1756641624071 notifier_gid 15525 2024-09-16T07:43:12.144 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 (50 ms) 2024-09-16T07:43:12.144 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 2024-09-16T07:43:12.181 INFO:tasks.workunit.client.0.smithi121.stdout:handle_notify cookie 29709920 notify_id 1756641624066 notifier_gid 15525 2024-09-16T07:43:12.196 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 (52 ms) 2024-09-16T07:43:12.196 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 2024-09-16T07:43:12.230 INFO:tasks.workunit.client.0.smithi121.stdout:handle_notify cookie 29709920 notify_id 1756641624068 notifier_gid 15525 2024-09-16T07:43:12.246 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 (49 ms) 2024-09-16T07:43:12.246 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 2024-09-16T07:43:12.279 INFO:tasks.workunit.client.0.smithi121.stdout:handle_notify cookie 29709920 notify_id 1756641624069 notifier_gid 15525 2024-09-16T07:43:12.295 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 (50 ms) 2024-09-16T07:43:12.295 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 2024-09-16T07:43:12.329 INFO:tasks.workunit.client.0.smithi121.stdout: trying... 2024-09-16T07:43:12.333 INFO:tasks.workunit.client.0.smithi121.stdout:handle_notify cookie 29709920 notify_id 1756641624064 notifier_gid 15525 2024-09-16T07:43:13.331 INFO:tasks.workunit.client.0.smithi121.stdout: timed out 2024-09-16T07:43:13.343 INFO:tasks.workunit.client.0.smithi121.stdout: flushing 2024-09-16T07:43:15.333 INFO:tasks.workunit.client.0.smithi121.stdout: flushed 2024-09-16T07:43:15.333 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 (3038 ms) 2024-09-16T07:43:15.333 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 2024-09-16T07:43:15.369 INFO:tasks.workunit.client.0.smithi121.stdout: trying... 2024-09-16T07:43:15.374 INFO:tasks.workunit.client.0.smithi121.stdout:handle_notify cookie 29709920 notify_id 1756641624067 notifier_gid 15525 2024-09-16T07:43:16.371 INFO:tasks.workunit.client.0.smithi121.stdout: timed out 2024-09-16T07:43:16.387 INFO:tasks.workunit.client.0.smithi121.stdout: flushing 2024-09-16T07:43:18.375 INFO:tasks.workunit.client.0.smithi121.stdout: flushed 2024-09-16T07:43:18.375 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 (3041 ms) 2024-09-16T07:43:18.375 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 2024-09-16T07:43:18.413 INFO:tasks.workunit.client.0.smithi121.stdout:List watches 2024-09-16T07:43:18.413 INFO:tasks.workunit.client.0.smithi121.stdout:notify2 2024-09-16T07:43:18.418 INFO:tasks.workunit.client.0.smithi121.stdout:handle_notify cookie 29742928 notify_id 1756641624070 notifier_gid 15525 2024-09-16T07:43:21.424 INFO:tasks.workunit.client.0.smithi121.stdout:notify2 done 2024-09-16T07:43:21.424 INFO:tasks.workunit.client.0.smithi121.stdout:watch_check 2024-09-16T07:43:21.424 INFO:tasks.workunit.client.0.smithi121.stdout:unwatch2 2024-09-16T07:43:21.439 INFO:tasks.workunit.client.0.smithi121.stdout: flushing 2024-09-16T07:43:21.439 INFO:tasks.workunit.client.0.smithi121.stdout:done 2024-09-16T07:43:21.439 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 (3065 ms) 2024-09-16T07:43:21.439 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 2024-09-16T07:43:21.472 INFO:tasks.workunit.client.0.smithi121.stdout:List watches 2024-09-16T07:43:21.472 INFO:tasks.workunit.client.0.smithi121.stdout:notify2 2024-09-16T07:43:21.476 INFO:tasks.workunit.client.0.smithi121.stdout:handle_notify cookie 29709920 notify_id 1760936591368 notifier_gid 15525 2024-09-16T07:43:24.482 INFO:tasks.workunit.client.0.smithi121.stdout:notify2 done 2024-09-16T07:43:24.483 INFO:tasks.workunit.client.0.smithi121.stdout:watch_check 2024-09-16T07:43:24.483 INFO:tasks.workunit.client.0.smithi121.stdout:unwatch2 2024-09-16T07:43:24.498 INFO:tasks.workunit.client.0.smithi121.stdout: flushing 2024-09-16T07:43:24.498 INFO:tasks.workunit.client.0.smithi121.stdout:done 2024-09-16T07:43:24.498 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 (3059 ms) 2024-09-16T07:43:24.556 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP (12960 ms total) 2024-09-16T07:43:24.556 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:43:24.556 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment tear-down 2024-09-16T07:43:24.556 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] 16 tests from 2 test suites ran. (15001 ms total) 2024-09-16T07:43:24.557 INFO:tasks.workunit.client.0.smithi121.stdout:[ PASSED ] 14 tests. 2024-09-16T07:43:24.557 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] 2 tests, listed below: 2024-09-16T07:43:24.557 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosWatchNotifyECPP.WatchNotify 2024-09-16T07:43:24.557 INFO:tasks.workunit.client.0.smithi121.stdout:[ SKIPPED ] LibRadosWatchNotifyECPP.WatchNotifyTimeout 2024-09-16T07:43:24.559 INFO:tasks.workunit.client.0.smithi121.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T07:43:24.559 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T07:43:24.559 INFO:tasks.workunit.client.0.smithi121.stderr:+ ceph_test_rados_api_cmd 2024-09-16T07:43:24.580 INFO:tasks.workunit.client.0.smithi121.stdout:Running main() from gmock_main.cc 2024-09-16T07:43:24.580 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-16T07:43:24.580 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment set-up. 2024-09-16T07:43:24.580 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 4 tests from LibRadosCmd 2024-09-16T07:43:24.580 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosCmd.MonDescribe 2024-09-16T07:43:24.640 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosCmd.MonDescribe (60 ms) 2024-09-16T07:43:24.640 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosCmd.OSDCmd 2024-09-16T07:43:24.708 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosCmd.OSDCmd (68 ms) 2024-09-16T07:43:24.709 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosCmd.PGCmd 2024-09-16T07:43:27.384 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosCmd.PGCmd (2676 ms) 2024-09-16T07:43:27.384 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosCmd.WatchLog 2024-09-16T07:43:27.430 INFO:tasks.workunit.client.0.smithi121.stdout:got: 2024-09-16T07:43:25.575081+0000 mon.a [INF] from='client.? 172.21.15.121:0/633939192' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-smithi121-93491-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2024-09-16T07:43:27.584 INFO:tasks.workunit.client.0.smithi121.stdout:got: 2024-09-16T07:43:26.566946+0000 mon.a [INF] from='client.? 172.21.15.121:0/633939192' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi121-93491-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-16T07:43:27.584 INFO:tasks.workunit.client.0.smithi121.stdout:got: 2024-09-16T07:43:27.431259+0000 client.admin [INF] onexx 2024-09-16T07:43:27.585 INFO:tasks.workunit.client.0.smithi121.stdout:got: 2024-09-16T07:43:27.431661+0000 mon.a [INF] from='client.? 172.21.15.121:0/2894919477' entity='client.admin' cmd={"prefix":"log", "logtext":["onexx"]} : dispatch 2024-09-16T07:43:28.583 INFO:tasks.workunit.client.0.smithi121.stdout:got: 2024-09-16T07:43:27.583569+0000 mon.a [INF] from='client.? 172.21.15.121:0/2894919477' entity='client.admin' cmd='[{"prefix":"log", "logtext":["onexx"]}]': finished 2024-09-16T07:43:31.587 INFO:tasks.workunit.client.0.smithi121.stdout:got: 2024-09-16T07:43:29.588108+0000 mon.a [INF] from='client.? 172.21.15.121:0/2894919477' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2024-09-16T07:43:32.594 INFO:tasks.workunit.client.0.smithi121.stdout:got: 2024-09-16T07:43:31.588813+0000 client.admin [INF] threexx 2024-09-16T07:43:32.595 INFO:tasks.workunit.client.0.smithi121.stdout:got: 2024-09-16T07:43:31.589501+0000 mon.a [INF] from='client.? 172.21.15.121:0/2894919477' entity='client.admin' cmd={"prefix":"log", "logtext":["threexx"]} : dispatch 2024-09-16T07:43:36.602 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosCmd.WatchLog (9217 ms) 2024-09-16T07:43:36.602 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 4 tests from LibRadosCmd (12021 ms total) 2024-09-16T07:43:36.602 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:43:36.602 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment tear-down 2024-09-16T07:43:36.603 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] 4 tests from 1 test suite ran. (12021 ms total) 2024-09-16T07:43:36.603 INFO:tasks.workunit.client.0.smithi121.stdout:[ PASSED ] 4 tests. 2024-09-16T07:43:36.604 INFO:tasks.workunit.client.0.smithi121.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T07:43:36.604 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T07:43:36.604 INFO:tasks.workunit.client.0.smithi121.stderr:+ ceph_test_rados_api_cmd_pp 2024-09-16T07:43:36.626 INFO:tasks.workunit.client.0.smithi121.stdout:Running main() from gmock_main.cc 2024-09-16T07:43:36.626 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] Running 3 tests from 1 test suite. 2024-09-16T07:43:36.626 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment set-up. 2024-09-16T07:43:36.626 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 3 tests from LibRadosCmd 2024-09-16T07:43:36.626 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosCmd.MonDescribePP 2024-09-16T07:43:36.664 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosCmd.MonDescribePP (37 ms) 2024-09-16T07:43:36.664 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosCmd.OSDCmdPP 2024-09-16T07:43:36.697 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosCmd.OSDCmdPP (34 ms) 2024-09-16T07:43:36.698 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosCmd.PGCmdPP 2024-09-16T07:43:38.385 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosCmd.PGCmdPP (1688 ms) 2024-09-16T07:43:38.385 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 3 tests from LibRadosCmd (1759 ms total) 2024-09-16T07:43:38.385 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:43:38.385 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment tear-down 2024-09-16T07:43:38.386 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] 3 tests from 1 test suite ran. (1759 ms total) 2024-09-16T07:43:38.386 INFO:tasks.workunit.client.0.smithi121.stdout:[ PASSED ] 3 tests. 2024-09-16T07:43:38.388 INFO:tasks.workunit.client.0.smithi121.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T07:43:38.388 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T07:43:38.388 INFO:tasks.workunit.client.0.smithi121.stderr:+ ceph_test_rados_api_service 2024-09-16T07:43:38.429 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:43:38.430+0000 7f06fff0f840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:38.429 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:43:38.430+0000 7f06fff0f840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:38.429 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:43:38.430+0000 7f06fff0f840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:38.430 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-16T07:43:38.430 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment set-up. 2024-09-16T07:43:38.430 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 4 tests from LibRadosService 2024-09-16T07:43:38.430 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosService.RegisterEarly 2024-09-16T07:43:43.486 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosService.RegisterEarly (5053 ms) 2024-09-16T07:43:43.486 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosService.RegisterLate 2024-09-16T07:43:43.511 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosService.RegisterLate (29 ms) 2024-09-16T07:43:43.511 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosService.StatusFormat 2024-09-16T07:43:43.661 INFO:tasks.workunit.client.0.smithi121.stdout: cluster: 2024-09-16T07:43:43.662 INFO:tasks.workunit.client.0.smithi121.stdout: id: 5b0c4070-0374-47d9-9f2a-f525ac27c89c 2024-09-16T07:43:43.662 INFO:tasks.workunit.client.0.smithi121.stdout: health: HEALTH_WARN 2024-09-16T07:43:43.662 INFO:tasks.workunit.client.0.smithi121.stdout: 1 pool(s) do not have an application enabled 2024-09-16T07:43:43.662 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:43:43.662 INFO:tasks.workunit.client.0.smithi121.stdout: services: 2024-09-16T07:43:43.662 INFO:tasks.workunit.client.0.smithi121.stdout: mon: 1 daemons, quorum a (age 10m) 2024-09-16T07:43:43.662 INFO:tasks.workunit.client.0.smithi121.stdout: mgr: x(active, since 9m) 2024-09-16T07:43:43.662 INFO:tasks.workunit.client.0.smithi121.stdout: osd: 4 osds: 4 up (since 9m), 4 in (since 9m) 2024-09-16T07:43:43.662 INFO:tasks.workunit.client.0.smithi121.stdout: laundry: 1 daemon active (1 hosts) 2024-09-16T07:43:43.662 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:43:43.662 INFO:tasks.workunit.client.0.smithi121.stdout: data: 2024-09-16T07:43:43.662 INFO:tasks.workunit.client.0.smithi121.stdout: pools: 3 pools, 41 pgs 2024-09-16T07:43:43.663 INFO:tasks.workunit.client.0.smithi121.stdout: objects: 5 objects, 577 KiB 2024-09-16T07:43:43.663 INFO:tasks.workunit.client.0.smithi121.stdout: usage: 183 MiB used, 360 GiB / 360 GiB avail 2024-09-16T07:43:43.663 INFO:tasks.workunit.client.0.smithi121.stdout: pgs: 41 active+clean 2024-09-16T07:43:43.663 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:43:43.663 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:43:45.689 INFO:tasks.workunit.client.0.smithi121.stdout: cluster: 2024-09-16T07:43:45.689 INFO:tasks.workunit.client.0.smithi121.stdout: id: 5b0c4070-0374-47d9-9f2a-f525ac27c89c 2024-09-16T07:43:45.689 INFO:tasks.workunit.client.0.smithi121.stdout: health: HEALTH_WARN 2024-09-16T07:43:45.689 INFO:tasks.workunit.client.0.smithi121.stdout: 1 pool(s) do not have an application enabled 2024-09-16T07:43:45.689 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:43:45.690 INFO:tasks.workunit.client.0.smithi121.stdout: services: 2024-09-16T07:43:45.690 INFO:tasks.workunit.client.0.smithi121.stdout: mon: 1 daemons, quorum a (age 10m) 2024-09-16T07:43:45.690 INFO:tasks.workunit.client.0.smithi121.stdout: mgr: x(active, since 9m) 2024-09-16T07:43:45.690 INFO:tasks.workunit.client.0.smithi121.stdout: osd: 4 osds: 4 up (since 9m), 4 in (since 10m) 2024-09-16T07:43:45.690 INFO:tasks.workunit.client.0.smithi121.stdout: foo: 16 portals active (1 hosts, 3 zones) 2024-09-16T07:43:45.690 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:43:45.690 INFO:tasks.workunit.client.0.smithi121.stdout: data: 2024-09-16T07:43:45.690 INFO:tasks.workunit.client.0.smithi121.stdout: pools: 3 pools, 41 pgs 2024-09-16T07:43:45.690 INFO:tasks.workunit.client.0.smithi121.stdout: objects: 5 objects, 577 KiB 2024-09-16T07:43:45.690 INFO:tasks.workunit.client.0.smithi121.stdout: usage: 183 MiB used, 360 GiB / 360 GiB avail 2024-09-16T07:43:45.690 INFO:tasks.workunit.client.0.smithi121.stdout: pgs: 41 active+clean 2024-09-16T07:43:45.690 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:43:45.690 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:43:45.714 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosService.StatusFormat (2203 ms) 2024-09-16T07:43:45.714 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosService.Status 2024-09-16T07:44:05.744 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosService.Status (20029 ms) 2024-09-16T07:44:05.744 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 4 tests from LibRadosService (27314 ms total) 2024-09-16T07:44:05.745 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:44:05.745 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment tear-down 2024-09-16T07:44:05.745 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] 4 tests from 1 test suite ran. (27314 ms total) 2024-09-16T07:44:05.745 INFO:tasks.workunit.client.0.smithi121.stdout:[ PASSED ] 4 tests. 2024-09-16T07:44:05.749 INFO:tasks.workunit.client.0.smithi121.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T07:44:05.749 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T07:44:05.749 INFO:tasks.workunit.client.0.smithi121.stderr:+ ceph_test_rados_api_service_pp 2024-09-16T07:44:05.784 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:44:05.784+0000 7f32c56dd840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:05.784 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:44:05.784+0000 7f32c56dd840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:05.784 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:44:05.785+0000 7f32c56dd840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:05.784 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-16T07:44:05.784 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment set-up. 2024-09-16T07:44:05.785 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 4 tests from LibRadosServicePP 2024-09-16T07:44:05.785 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosServicePP.RegisterEarly 2024-09-16T07:44:10.811 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosServicePP.RegisterEarly (5027 ms) 2024-09-16T07:44:10.812 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosServicePP.RegisterLate 2024-09-16T07:44:10.855 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosServicePP.RegisterLate (44 ms) 2024-09-16T07:44:10.856 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosServicePP.Status 2024-09-16T07:44:30.883 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosServicePP.Status (20028 ms) 2024-09-16T07:44:30.884 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosServicePP.Close 2024-09-16T07:44:30.884 INFO:tasks.workunit.client.0.smithi121.stdout:attempt 0 of 20 2024-09-16T07:44:35.938 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosServicePP.Close (5055 ms) 2024-09-16T07:44:35.938 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 4 tests from LibRadosServicePP (30154 ms total) 2024-09-16T07:44:35.938 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:44:35.938 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment tear-down 2024-09-16T07:44:35.938 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] 4 tests from 1 test suite ran. (30154 ms total) 2024-09-16T07:44:35.938 INFO:tasks.workunit.client.0.smithi121.stdout:[ PASSED ] 4 tests. 2024-09-16T07:44:35.941 INFO:tasks.workunit.client.0.smithi121.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T07:44:35.941 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T07:44:35.941 INFO:tasks.workunit.client.0.smithi121.stderr:+ ceph_test_rados_api_c_write_operations 2024-09-16T07:44:35.962 INFO:tasks.workunit.client.0.smithi121.stdout:Running main() from gmock_main.cc 2024-09-16T07:44:35.963 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] Running 8 tests from 2 test suites. 2024-09-16T07:44:35.963 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment set-up. 2024-09-16T07:44:35.963 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 1 test from LibradosCWriteOps 2024-09-16T07:44:35.963 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibradosCWriteOps.NewDelete 2024-09-16T07:44:35.963 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibradosCWriteOps.NewDelete (0 ms) 2024-09-16T07:44:35.963 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 1 test from LibradosCWriteOps (0 ms total) 2024-09-16T07:44:35.963 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:44:35.963 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 7 tests from LibRadosCWriteOps 2024-09-16T07:44:35.963 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosCWriteOps.assertExists 2024-09-16T07:44:38.451 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosCWriteOps.assertExists (2489 ms) 2024-09-16T07:44:38.451 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosCWriteOps.WriteOpAssertVersion 2024-09-16T07:44:41.466 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosCWriteOps.WriteOpAssertVersion (3014 ms) 2024-09-16T07:44:41.466 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosCWriteOps.Xattrs 2024-09-16T07:44:44.482 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosCWriteOps.Xattrs (3017 ms) 2024-09-16T07:44:44.482 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosCWriteOps.Write 2024-09-16T07:44:47.494 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosCWriteOps.Write (3012 ms) 2024-09-16T07:44:47.495 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosCWriteOps.Exec 2024-09-16T07:44:50.511 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosCWriteOps.Exec (3017 ms) 2024-09-16T07:44:50.512 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosCWriteOps.WriteSame 2024-09-16T07:44:53.412 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosCWriteOps.WriteSame (2901 ms) 2024-09-16T07:44:53.412 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] LibRadosCWriteOps.CmpExt 2024-09-16T07:45:04.444 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] LibRadosCWriteOps.CmpExt (11032 ms) 2024-09-16T07:45:04.444 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 7 tests from LibRadosCWriteOps (28482 ms total) 2024-09-16T07:45:04.444 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:45:04.445 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment tear-down 2024-09-16T07:45:04.445 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] 8 tests from 2 test suites ran. (28482 ms total) 2024-09-16T07:45:04.445 INFO:tasks.workunit.client.0.smithi121.stdout:[ PASSED ] 8 tests. 2024-09-16T07:45:04.447 INFO:tasks.workunit.client.0.smithi121.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T07:45:04.447 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T07:45:04.447 INFO:tasks.workunit.client.0.smithi121.stderr:+ ceph_test_rados_api_c_read_operations 2024-09-16T07:45:04.466 INFO:tasks.workunit.client.0.smithi121.stdout:Running main() from gmock_main.cc 2024-09-16T07:45:04.466 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] Running 17 tests from 1 test suite. 2024-09-16T07:45:04.466 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment set-up. 2024-09-16T07:45:04.466 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 17 tests from CReadOpsTest 2024-09-16T07:45:06.448 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] CReadOpsTest.NewDelete 2024-09-16T07:45:06.448 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] CReadOpsTest.NewDelete (0 ms) 2024-09-16T07:45:06.448 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] CReadOpsTest.SetOpFlags 2024-09-16T07:45:06.714 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] CReadOpsTest.SetOpFlags (266 ms) 2024-09-16T07:45:06.714 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] CReadOpsTest.AssertExists 2024-09-16T07:45:06.751 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] CReadOpsTest.AssertExists (37 ms) 2024-09-16T07:45:06.751 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] CReadOpsTest.AssertVersion 2024-09-16T07:45:06.804 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] CReadOpsTest.AssertVersion (53 ms) 2024-09-16T07:45:06.804 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] CReadOpsTest.CmpXattr 2024-09-16T07:45:06.977 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] CReadOpsTest.CmpXattr (173 ms) 2024-09-16T07:45:06.978 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] CReadOpsTest.Read 2024-09-16T07:45:07.032 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] CReadOpsTest.Read (54 ms) 2024-09-16T07:45:07.032 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] CReadOpsTest.Checksum 2024-09-16T07:45:07.078 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] CReadOpsTest.Checksum (47 ms) 2024-09-16T07:45:07.078 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] CReadOpsTest.RWOrderedRead 2024-09-16T07:45:07.107 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] CReadOpsTest.RWOrderedRead (29 ms) 2024-09-16T07:45:07.108 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] CReadOpsTest.ShortRead 2024-09-16T07:45:07.154 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] CReadOpsTest.ShortRead (46 ms) 2024-09-16T07:45:07.154 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] CReadOpsTest.Exec 2024-09-16T07:45:07.189 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] CReadOpsTest.Exec (36 ms) 2024-09-16T07:45:07.190 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] CReadOpsTest.ExecUserBuf 2024-09-16T07:45:07.230 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] CReadOpsTest.ExecUserBuf (41 ms) 2024-09-16T07:45:07.230 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] CReadOpsTest.Stat 2024-09-16T07:45:07.266 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] CReadOpsTest.Stat (36 ms) 2024-09-16T07:45:07.266 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] CReadOpsTest.Stat2 2024-09-16T07:45:07.309 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] CReadOpsTest.Stat2 (43 ms) 2024-09-16T07:45:07.309 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] CReadOpsTest.Omap 2024-09-16T07:45:07.449 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] CReadOpsTest.Omap (140 ms) 2024-09-16T07:45:07.449 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] CReadOpsTest.OmapNuls 2024-09-16T07:45:07.550 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] CReadOpsTest.OmapNuls (101 ms) 2024-09-16T07:45:07.550 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] CReadOpsTest.GetXattrs 2024-09-16T07:45:07.627 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] CReadOpsTest.GetXattrs (77 ms) 2024-09-16T07:45:07.627 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] CReadOpsTest.CmpExt 2024-09-16T07:45:07.664 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] CReadOpsTest.CmpExt (37 ms) 2024-09-16T07:45:08.467 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 17 tests from CReadOpsTest (1216 ms total) 2024-09-16T07:45:08.467 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:45:08.467 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment tear-down 2024-09-16T07:45:08.467 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] 17 tests from 1 test suite ran. (4001 ms total) 2024-09-16T07:45:08.468 INFO:tasks.workunit.client.0.smithi121.stdout:[ PASSED ] 17 tests. 2024-09-16T07:45:08.470 INFO:tasks.workunit.client.0.smithi121.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T07:45:08.470 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T07:45:08.470 INFO:tasks.workunit.client.0.smithi121.stderr:+ ceph_test_rados_list_parallel 2024-09-16T07:45:11.377 INFO:tasks.workunit.client.0.smithi121.stdout:process_1_[94170]: starting. 2024-09-16T07:45:11.377 INFO:tasks.workunit.client.0.smithi121.stdout:process_1_[94170]: creating pool ceph_test_rados_list_parallel.smithi121-94169 2024-09-16T07:45:11.378 INFO:tasks.workunit.client.0.smithi121.stdout:process_1_[94170]: created object 0... 2024-09-16T07:45:11.378 INFO:tasks.workunit.client.0.smithi121.stdout:process_1_[94170]: created object 25... 2024-09-16T07:45:11.378 INFO:tasks.workunit.client.0.smithi121.stdout:process_1_[94170]: created object 49... 2024-09-16T07:45:11.378 INFO:tasks.workunit.client.0.smithi121.stdout:process_1_[94170]: finishing. 2024-09-16T07:45:11.378 INFO:tasks.workunit.client.0.smithi121.stdout:process_1_[94170]: shutting down. 2024-09-16T07:45:11.519 INFO:tasks.workunit.client.0.smithi121.stdout:process_2_[94171]: starting. 2024-09-16T07:45:11.519 INFO:tasks.workunit.client.0.smithi121.stdout:process_2_[94171]: listing objects. 2024-09-16T07:45:11.519 INFO:tasks.workunit.client.0.smithi121.stdout:process_2_[94171]: listed object 0... 2024-09-16T07:45:11.519 INFO:tasks.workunit.client.0.smithi121.stdout:process_2_[94171]: listed object 25... 2024-09-16T07:45:11.519 INFO:tasks.workunit.client.0.smithi121.stdout:process_2_[94171]: saw 50 objects 2024-09-16T07:45:11.519 INFO:tasks.workunit.client.0.smithi121.stdout:process_2_[94171]: shutting down. 2024-09-16T07:45:12.172 INFO:tasks.workunit.client.0.smithi121.stdout:******************************* 2024-09-16T07:45:12.172 INFO:tasks.workunit.client.0.smithi121.stdout:process_3_[94206]: starting. 2024-09-16T07:45:12.172 INFO:tasks.workunit.client.0.smithi121.stdout:process_3_[94206]: creating pool ceph_test_rados_list_parallel.smithi121-94169 2024-09-16T07:45:12.172 INFO:tasks.workunit.client.0.smithi121.stdout:process_3_[94206]: created object 0... 2024-09-16T07:45:12.172 INFO:tasks.workunit.client.0.smithi121.stdout:process_3_[94206]: created object 25... 2024-09-16T07:45:12.172 INFO:tasks.workunit.client.0.smithi121.stdout:process_3_[94206]: created object 49... 2024-09-16T07:45:12.172 INFO:tasks.workunit.client.0.smithi121.stdout:process_3_[94206]: finishing. 2024-09-16T07:45:12.173 INFO:tasks.workunit.client.0.smithi121.stdout:process_3_[94206]: shutting down. 2024-09-16T07:45:12.488 INFO:tasks.workunit.client.0.smithi121.stdout:******************************* 2024-09-16T07:45:12.489 INFO:tasks.workunit.client.0.smithi121.stdout:process_4_[94207]: starting. 2024-09-16T07:45:12.489 INFO:tasks.workunit.client.0.smithi121.stdout:process_4_[94207]: listing objects. 2024-09-16T07:45:12.489 INFO:tasks.workunit.client.0.smithi121.stdout:process_4_[94207]: listed object 0... 2024-09-16T07:45:12.489 INFO:tasks.workunit.client.0.smithi121.stdout:process_4_[94207]: listed object 25... 2024-09-16T07:45:12.489 INFO:tasks.workunit.client.0.smithi121.stdout:process_4_[94207]: saw 43 objects 2024-09-16T07:45:12.489 INFO:tasks.workunit.client.0.smithi121.stdout:process_4_[94207]: shutting down. 2024-09-16T07:45:12.792 INFO:tasks.workunit.client.0.smithi121.stdout:******************************* 2024-09-16T07:45:12.793 INFO:tasks.workunit.client.0.smithi121.stdout:process_5_[94208]: starting. 2024-09-16T07:45:12.793 INFO:tasks.workunit.client.0.smithi121.stdout:process_5_[94208]: removed 25 objects... 2024-09-16T07:45:12.793 INFO:tasks.workunit.client.0.smithi121.stdout:process_5_[94208]: removed half of the objects 2024-09-16T07:45:12.793 INFO:tasks.workunit.client.0.smithi121.stdout:process_5_[94208]: removed 50 objects... 2024-09-16T07:45:12.793 INFO:tasks.workunit.client.0.smithi121.stdout:process_5_[94208]: removed 50 objects 2024-09-16T07:45:12.793 INFO:tasks.workunit.client.0.smithi121.stdout:process_5_[94208]: shutting down. 2024-09-16T07:45:13.468 INFO:tasks.workunit.client.0.smithi121.stdout:******************************* 2024-09-16T07:45:13.468 INFO:tasks.workunit.client.0.smithi121.stdout:******************************* 2024-09-16T07:45:13.469 INFO:tasks.workunit.client.0.smithi121.stdout:process_6_[94257]: starting. 2024-09-16T07:45:13.469 INFO:tasks.workunit.client.0.smithi121.stdout:process_6_[94257]: creating pool ceph_test_rados_list_parallel.smithi121-94169 2024-09-16T07:45:13.469 INFO:tasks.workunit.client.0.smithi121.stdout:process_6_[94257]: created object 0... 2024-09-16T07:45:13.469 INFO:tasks.workunit.client.0.smithi121.stdout:process_6_[94257]: created object 25... 2024-09-16T07:45:13.469 INFO:tasks.workunit.client.0.smithi121.stdout:process_6_[94257]: created object 49... 2024-09-16T07:45:13.469 INFO:tasks.workunit.client.0.smithi121.stdout:process_6_[94257]: finishing. 2024-09-16T07:45:13.470 INFO:tasks.workunit.client.0.smithi121.stdout:process_6_[94257]: shutting down. 2024-09-16T07:45:13.825 INFO:tasks.workunit.client.0.smithi121.stdout:******************************* 2024-09-16T07:45:13.825 INFO:tasks.workunit.client.0.smithi121.stdout:******************************* 2024-09-16T07:45:13.825 INFO:tasks.workunit.client.0.smithi121.stdout:process_7_[94258]: starting. 2024-09-16T07:45:13.825 INFO:tasks.workunit.client.0.smithi121.stdout:process_7_[94258]: listing objects. 2024-09-16T07:45:13.825 INFO:tasks.workunit.client.0.smithi121.stdout:process_7_[94258]: listed object 0... 2024-09-16T07:45:13.826 INFO:tasks.workunit.client.0.smithi121.stdout:process_7_[94258]: listed object 25... 2024-09-16T07:45:13.826 INFO:tasks.workunit.client.0.smithi121.stdout:process_7_[94258]: listed object 50... 2024-09-16T07:45:13.826 INFO:tasks.workunit.client.0.smithi121.stdout:process_7_[94258]: saw 56 objects 2024-09-16T07:45:13.826 INFO:tasks.workunit.client.0.smithi121.stdout:process_7_[94258]: shutting down. 2024-09-16T07:45:14.165 INFO:tasks.workunit.client.0.smithi121.stdout:******************************* 2024-09-16T07:45:14.165 INFO:tasks.workunit.client.0.smithi121.stdout:******************************* 2024-09-16T07:45:14.166 INFO:tasks.workunit.client.0.smithi121.stdout:process_8_[94259]: starting. 2024-09-16T07:45:14.166 INFO:tasks.workunit.client.0.smithi121.stdout:process_8_[94259]: added 25 objects... 2024-09-16T07:45:14.166 INFO:tasks.workunit.client.0.smithi121.stdout:process_8_[94259]: added half of the objects 2024-09-16T07:45:14.166 INFO:tasks.workunit.client.0.smithi121.stdout:process_8_[94259]: added 50 objects... 2024-09-16T07:45:14.166 INFO:tasks.workunit.client.0.smithi121.stdout:process_8_[94259]: added 50 objects 2024-09-16T07:45:14.166 INFO:tasks.workunit.client.0.smithi121.stdout:process_8_[94259]: shutting down. 2024-09-16T07:45:14.843 INFO:tasks.workunit.client.0.smithi121.stdout:******************************* 2024-09-16T07:45:14.843 INFO:tasks.workunit.client.0.smithi121.stdout:******************************* 2024-09-16T07:45:14.843 INFO:tasks.workunit.client.0.smithi121.stdout:******************************* 2024-09-16T07:45:14.843 INFO:tasks.workunit.client.0.smithi121.stdout:process_9_[94308]: starting. 2024-09-16T07:45:14.844 INFO:tasks.workunit.client.0.smithi121.stdout:process_9_[94308]: creating pool ceph_test_rados_list_parallel.smithi121-94169 2024-09-16T07:45:14.844 INFO:tasks.workunit.client.0.smithi121.stdout:process_9_[94308]: created object 0... 2024-09-16T07:45:14.844 INFO:tasks.workunit.client.0.smithi121.stdout:process_9_[94308]: created object 25... 2024-09-16T07:45:14.844 INFO:tasks.workunit.client.0.smithi121.stdout:process_9_[94308]: created object 49... 2024-09-16T07:45:14.844 INFO:tasks.workunit.client.0.smithi121.stdout:process_9_[94308]: finishing. 2024-09-16T07:45:14.844 INFO:tasks.workunit.client.0.smithi121.stdout:process_9_[94308]: shutting down. 2024-09-16T07:45:15.266 INFO:tasks.workunit.client.0.smithi121.stdout:******************************* 2024-09-16T07:45:15.266 INFO:tasks.workunit.client.0.smithi121.stdout:******************************* 2024-09-16T07:45:15.266 INFO:tasks.workunit.client.0.smithi121.stdout:******************************* 2024-09-16T07:45:15.266 INFO:tasks.workunit.client.0.smithi121.stdout:process_10_[94309]: starting. 2024-09-16T07:45:15.266 INFO:tasks.workunit.client.0.smithi121.stdout:process_10_[94309]: listing objects. 2024-09-16T07:45:15.266 INFO:tasks.workunit.client.0.smithi121.stdout:process_10_[94309]: listed object 0... 2024-09-16T07:45:15.266 INFO:tasks.workunit.client.0.smithi121.stdout:process_10_[94309]: listed object 25... 2024-09-16T07:45:15.266 INFO:tasks.workunit.client.0.smithi121.stdout:process_10_[94309]: listed object 50... 2024-09-16T07:45:15.267 INFO:tasks.workunit.client.0.smithi121.stdout:process_10_[94309]: listed object 75... 2024-09-16T07:45:15.267 INFO:tasks.workunit.client.0.smithi121.stdout:process_10_[94309]: saw 99 objects 2024-09-16T07:45:15.267 INFO:tasks.workunit.client.0.smithi121.stdout:process_10_[94309]: shutting down. 2024-09-16T07:45:15.626 INFO:tasks.workunit.client.0.smithi121.stdout:******************************* 2024-09-16T07:45:15.627 INFO:tasks.workunit.client.0.smithi121.stdout:******************************* 2024-09-16T07:45:15.627 INFO:tasks.workunit.client.0.smithi121.stdout:******************************* 2024-09-16T07:45:15.627 INFO:tasks.workunit.client.0.smithi121.stdout:process_13_[94312]: starting. 2024-09-16T07:45:15.627 INFO:tasks.workunit.client.0.smithi121.stdout:process_13_[94312]: removed 25 objects... 2024-09-16T07:45:15.627 INFO:tasks.workunit.client.0.smithi121.stdout:process_13_[94312]: removed half of the objects 2024-09-16T07:45:15.627 INFO:tasks.workunit.client.0.smithi121.stdout:process_13_[94312]: removed 50 objects... 2024-09-16T07:45:15.627 INFO:tasks.workunit.client.0.smithi121.stdout:process_13_[94312]: removed 50 objects 2024-09-16T07:45:15.627 INFO:tasks.workunit.client.0.smithi121.stdout:process_13_[94312]: shutting down. 2024-09-16T07:45:15.695 INFO:tasks.workunit.client.0.smithi121.stdout:******************************* 2024-09-16T07:45:15.695 INFO:tasks.workunit.client.0.smithi121.stdout:******************************* 2024-09-16T07:45:15.695 INFO:tasks.workunit.client.0.smithi121.stdout:******************************* 2024-09-16T07:45:15.695 INFO:tasks.workunit.client.0.smithi121.stdout:process_11_[94310]: starting. 2024-09-16T07:45:15.695 INFO:tasks.workunit.client.0.smithi121.stdout:process_11_[94310]: added 25 objects... 2024-09-16T07:45:15.695 INFO:tasks.workunit.client.0.smithi121.stdout:process_11_[94310]: added half of the objects 2024-09-16T07:45:15.695 INFO:tasks.workunit.client.0.smithi121.stdout:process_11_[94310]: added 50 objects... 2024-09-16T07:45:15.695 INFO:tasks.workunit.client.0.smithi121.stdout:process_11_[94310]: added 50 objects 2024-09-16T07:45:15.695 INFO:tasks.workunit.client.0.smithi121.stdout:process_11_[94310]: shutting down. 2024-09-16T07:45:15.723 INFO:tasks.workunit.client.0.smithi121.stdout:******************************* 2024-09-16T07:45:15.724 INFO:tasks.workunit.client.0.smithi121.stdout:******************************* 2024-09-16T07:45:15.724 INFO:tasks.workunit.client.0.smithi121.stdout:******************************* 2024-09-16T07:45:15.724 INFO:tasks.workunit.client.0.smithi121.stdout:process_12_[94311]: starting. 2024-09-16T07:45:15.724 INFO:tasks.workunit.client.0.smithi121.stdout:process_12_[94311]: added 25 objects... 2024-09-16T07:45:15.724 INFO:tasks.workunit.client.0.smithi121.stdout:process_12_[94311]: added half of the objects 2024-09-16T07:45:15.724 INFO:tasks.workunit.client.0.smithi121.stdout:process_12_[94311]: added 50 objects... 2024-09-16T07:45:15.724 INFO:tasks.workunit.client.0.smithi121.stdout:process_12_[94311]: added 50 objects 2024-09-16T07:45:15.724 INFO:tasks.workunit.client.0.smithi121.stdout:process_12_[94311]: shutting down. 2024-09-16T07:45:16.389 INFO:tasks.workunit.client.0.smithi121.stdout:******************************* 2024-09-16T07:45:16.389 INFO:tasks.workunit.client.0.smithi121.stdout:******************************* 2024-09-16T07:45:16.389 INFO:tasks.workunit.client.0.smithi121.stdout:******************************* 2024-09-16T07:45:16.389 INFO:tasks.workunit.client.0.smithi121.stdout:******************************* 2024-09-16T07:45:16.389 INFO:tasks.workunit.client.0.smithi121.stdout:process_14_[94393]: starting. 2024-09-16T07:45:16.390 INFO:tasks.workunit.client.0.smithi121.stdout:process_14_[94393]: creating pool ceph_test_rados_list_parallel.smithi121-94169 2024-09-16T07:45:16.390 INFO:tasks.workunit.client.0.smithi121.stdout:process_14_[94393]: created object 0... 2024-09-16T07:45:16.390 INFO:tasks.workunit.client.0.smithi121.stdout:process_14_[94393]: created object 25... 2024-09-16T07:45:16.390 INFO:tasks.workunit.client.0.smithi121.stdout:process_14_[94393]: created object 49... 2024-09-16T07:45:16.390 INFO:tasks.workunit.client.0.smithi121.stdout:process_14_[94393]: finishing. 2024-09-16T07:45:16.390 INFO:tasks.workunit.client.0.smithi121.stdout:process_14_[94393]: shutting down. 2024-09-16T07:45:16.730 INFO:tasks.workunit.client.0.smithi121.stdout:******************************* 2024-09-16T07:45:16.730 INFO:tasks.workunit.client.0.smithi121.stdout:******************************* 2024-09-16T07:45:16.730 INFO:tasks.workunit.client.0.smithi121.stdout:******************************* 2024-09-16T07:45:16.730 INFO:tasks.workunit.client.0.smithi121.stdout:******************************* 2024-09-16T07:45:16.730 INFO:tasks.workunit.client.0.smithi121.stdout:process_15_[94394]: starting. 2024-09-16T07:45:16.730 INFO:tasks.workunit.client.0.smithi121.stdout:process_15_[94394]: listing objects. 2024-09-16T07:45:16.730 INFO:tasks.workunit.client.0.smithi121.stdout:process_15_[94394]: listed object 0... 2024-09-16T07:45:16.731 INFO:tasks.workunit.client.0.smithi121.stdout:process_15_[94394]: listed object 25... 2024-09-16T07:45:16.731 INFO:tasks.workunit.client.0.smithi121.stdout:process_15_[94394]: listed object 50... 2024-09-16T07:45:16.731 INFO:tasks.workunit.client.0.smithi121.stdout:process_15_[94394]: listed object 75... 2024-09-16T07:45:16.731 INFO:tasks.workunit.client.0.smithi121.stdout:process_15_[94394]: listed object 100... 2024-09-16T07:45:16.731 INFO:tasks.workunit.client.0.smithi121.stdout:process_15_[94394]: listed object 125... 2024-09-16T07:45:16.731 INFO:tasks.workunit.client.0.smithi121.stdout:process_15_[94394]: saw 150 objects 2024-09-16T07:45:16.731 INFO:tasks.workunit.client.0.smithi121.stdout:process_15_[94394]: shutting down. 2024-09-16T07:45:17.047 INFO:tasks.workunit.client.0.smithi121.stdout:******************************* 2024-09-16T07:45:17.047 INFO:tasks.workunit.client.0.smithi121.stdout:******************************* 2024-09-16T07:45:17.047 INFO:tasks.workunit.client.0.smithi121.stdout:******************************* 2024-09-16T07:45:17.047 INFO:tasks.workunit.client.0.smithi121.stdout:******************************* 2024-09-16T07:45:17.047 INFO:tasks.workunit.client.0.smithi121.stdout:process_16_[94395]: starting. 2024-09-16T07:45:17.047 INFO:tasks.workunit.client.0.smithi121.stdout:process_16_[94395]: added 25 objects... 2024-09-16T07:45:17.047 INFO:tasks.workunit.client.0.smithi121.stdout:process_16_[94395]: added half of the objects 2024-09-16T07:45:17.047 INFO:tasks.workunit.client.0.smithi121.stdout:process_16_[94395]: added 50 objects... 2024-09-16T07:45:17.047 INFO:tasks.workunit.client.0.smithi121.stdout:process_16_[94395]: added 50 objects 2024-09-16T07:45:17.047 INFO:tasks.workunit.client.0.smithi121.stdout:process_16_[94395]: shutting down. 2024-09-16T07:45:17.483 INFO:tasks.workunit.client.0.smithi121.stdout:******************************* 2024-09-16T07:45:17.483 INFO:tasks.workunit.client.0.smithi121.stdout:******************************* 2024-09-16T07:45:17.483 INFO:tasks.workunit.client.0.smithi121.stdout:******************************* 2024-09-16T07:45:17.483 INFO:tasks.workunit.client.0.smithi121.stdout:******************************* 2024-09-16T07:45:17.483 INFO:tasks.workunit.client.0.smithi121.stdout:******************************* 2024-09-16T07:45:17.483 INFO:tasks.workunit.client.0.smithi121.stdout:******* SUCCESS ********** 2024-09-16T07:45:17.484 INFO:tasks.workunit.client.0.smithi121.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T07:45:17.484 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T07:45:17.484 INFO:tasks.workunit.client.0.smithi121.stderr:+ ceph_test_rados_open_pools_parallel 2024-09-16T07:45:20.419 INFO:tasks.workunit.client.0.smithi121.stdout:process_1_[94461]: starting. 2024-09-16T07:45:20.419 INFO:tasks.workunit.client.0.smithi121.stdout:process_1_[94461]: creating pool ceph_test_rados_open_pools_parallel.smithi121-94460 2024-09-16T07:45:20.419 INFO:tasks.workunit.client.0.smithi121.stdout:process_1_[94461]: created object 0... 2024-09-16T07:45:20.420 INFO:tasks.workunit.client.0.smithi121.stdout:process_1_[94461]: created object 25... 2024-09-16T07:45:20.420 INFO:tasks.workunit.client.0.smithi121.stdout:process_1_[94461]: created object 49... 2024-09-16T07:45:20.420 INFO:tasks.workunit.client.0.smithi121.stdout:process_1_[94461]: finishing. 2024-09-16T07:45:20.420 INFO:tasks.workunit.client.0.smithi121.stdout:process_1_[94461]: shutting down. 2024-09-16T07:45:20.498 INFO:tasks.workunit.client.0.smithi121.stdout:process_2_[94462]: starting. 2024-09-16T07:45:20.498 INFO:tasks.workunit.client.0.smithi121.stdout:process_2_[94462]: rados_pool_create. 2024-09-16T07:45:20.498 INFO:tasks.workunit.client.0.smithi121.stdout:process_2_[94462]: rados_ioctx_create. 2024-09-16T07:45:20.498 INFO:tasks.workunit.client.0.smithi121.stdout:process_2_[94462]: shutting down. 2024-09-16T07:45:23.321 INFO:tasks.workunit.client.0.smithi121.stdout:******************************* 2024-09-16T07:45:23.321 INFO:tasks.workunit.client.0.smithi121.stdout:process_3_[94497]: starting. 2024-09-16T07:45:23.321 INFO:tasks.workunit.client.0.smithi121.stdout:process_3_[94497]: creating pool ceph_test_rados_open_pools_parallel.smithi121-94460 2024-09-16T07:45:23.321 INFO:tasks.workunit.client.0.smithi121.stdout:process_3_[94497]: created object 0... 2024-09-16T07:45:23.321 INFO:tasks.workunit.client.0.smithi121.stdout:process_3_[94497]: created object 25... 2024-09-16T07:45:23.321 INFO:tasks.workunit.client.0.smithi121.stdout:process_3_[94497]: created object 49... 2024-09-16T07:45:23.322 INFO:tasks.workunit.client.0.smithi121.stdout:process_3_[94497]: finishing. 2024-09-16T07:45:23.322 INFO:tasks.workunit.client.0.smithi121.stdout:process_3_[94497]: shutting down. 2024-09-16T07:45:23.512 INFO:tasks.workunit.client.0.smithi121.stdout:******************************* 2024-09-16T07:45:23.512 INFO:tasks.workunit.client.0.smithi121.stdout:process_4_[94498]: starting. 2024-09-16T07:45:23.512 INFO:tasks.workunit.client.0.smithi121.stdout:process_4_[94498]: rados_pool_create. 2024-09-16T07:45:23.513 INFO:tasks.workunit.client.0.smithi121.stdout:process_4_[94498]: rados_ioctx_create. 2024-09-16T07:45:23.513 INFO:tasks.workunit.client.0.smithi121.stdout:process_4_[94498]: shutting down. 2024-09-16T07:45:23.514 INFO:tasks.workunit.client.0.smithi121.stdout:******************************* 2024-09-16T07:45:23.514 INFO:tasks.workunit.client.0.smithi121.stdout:******************************* 2024-09-16T07:45:23.514 INFO:tasks.workunit.client.0.smithi121.stdout:******* SUCCESS ********** 2024-09-16T07:45:23.514 INFO:tasks.workunit.client.0.smithi121.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-16T07:45:23.515 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T07:45:23.515 INFO:tasks.workunit.client.0.smithi121.stderr:+ ceph_test_rados_delete_pools_parallel 2024-09-16T07:45:26.438 INFO:tasks.workunit.client.0.smithi121.stdout:process_1_[94534]: starting. 2024-09-16T07:45:26.439 INFO:tasks.workunit.client.0.smithi121.stdout:process_1_[94534]: creating pool ceph_test_rados_delete_pools_parallel.smithi121-94533 2024-09-16T07:45:26.439 INFO:tasks.workunit.client.0.smithi121.stdout:process_1_[94534]: created object 0... 2024-09-16T07:45:26.439 INFO:tasks.workunit.client.0.smithi121.stdout:process_1_[94534]: created object 25... 2024-09-16T07:45:26.439 INFO:tasks.workunit.client.0.smithi121.stdout:process_1_[94534]: created object 49... 2024-09-16T07:45:26.439 INFO:tasks.workunit.client.0.smithi121.stdout:process_1_[94534]: finishing. 2024-09-16T07:45:26.439 INFO:tasks.workunit.client.0.smithi121.stdout:process_1_[94534]: shutting down. 2024-09-16T07:45:26.523 INFO:tasks.workunit.client.0.smithi121.stdout:process_2_[94535]: starting. 2024-09-16T07:45:26.523 INFO:tasks.workunit.client.0.smithi121.stdout:process_2_[94535]: deleting pool ceph_test_rados_delete_pools_parallel.smithi121-94533 2024-09-16T07:45:26.523 INFO:tasks.workunit.client.0.smithi121.stdout:process_2_[94535]: shutting down. 2024-09-16T07:45:29.498 INFO:tasks.workunit.client.0.smithi121.stdout:******************************* 2024-09-16T07:45:29.498 INFO:tasks.workunit.client.0.smithi121.stdout:process_3_[94570]: starting. 2024-09-16T07:45:29.498 INFO:tasks.workunit.client.0.smithi121.stdout:process_3_[94570]: creating pool ceph_test_rados_delete_pools_parallel.smithi121-94533 2024-09-16T07:45:29.498 INFO:tasks.workunit.client.0.smithi121.stdout:process_3_[94570]: created object 0... 2024-09-16T07:45:29.498 INFO:tasks.workunit.client.0.smithi121.stdout:process_3_[94570]: created object 25... 2024-09-16T07:45:29.498 INFO:tasks.workunit.client.0.smithi121.stdout:process_3_[94570]: created object 49... 2024-09-16T07:45:29.498 INFO:tasks.workunit.client.0.smithi121.stdout:process_3_[94570]: finishing. 2024-09-16T07:45:29.498 INFO:tasks.workunit.client.0.smithi121.stdout:process_3_[94570]: shutting down. 2024-09-16T07:45:29.640 INFO:tasks.workunit.client.0.smithi121.stdout:******************************* 2024-09-16T07:45:29.640 INFO:tasks.workunit.client.0.smithi121.stdout:process_5_[94572]: starting. 2024-09-16T07:45:29.640 INFO:tasks.workunit.client.0.smithi121.stdout:process_5_[94572]: listing objects. 2024-09-16T07:45:29.640 INFO:tasks.workunit.client.0.smithi121.stdout:process_5_[94572]: listed object 0... 2024-09-16T07:45:29.640 INFO:tasks.workunit.client.0.smithi121.stdout:process_5_[94572]: listed object 25... 2024-09-16T07:45:29.640 INFO:tasks.workunit.client.0.smithi121.stdout:process_5_[94572]: saw 50 objects 2024-09-16T07:45:29.640 INFO:tasks.workunit.client.0.smithi121.stdout:process_5_[94572]: shutting down. 2024-09-16T07:45:30.543 INFO:tasks.workunit.client.0.smithi121.stdout:******************************* 2024-09-16T07:45:30.543 INFO:tasks.workunit.client.0.smithi121.stdout:process_4_[94571]: starting. 2024-09-16T07:45:30.543 INFO:tasks.workunit.client.0.smithi121.stdout:process_4_[94571]: deleting pool ceph_test_rados_delete_pools_parallel.smithi121-94533 2024-09-16T07:45:30.543 INFO:tasks.workunit.client.0.smithi121.stdout:process_4_[94571]: shutting down. 2024-09-16T07:45:30.544 INFO:tasks.workunit.client.0.smithi121.stdout:******************************* 2024-09-16T07:45:30.544 INFO:tasks.workunit.client.0.smithi121.stdout:******************************* 2024-09-16T07:45:30.544 INFO:tasks.workunit.client.0.smithi121.stdout:******* SUCCESS ********** 2024-09-16T07:45:30.545 INFO:tasks.workunit.client.0.smithi121.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-16T07:45:30.545 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T07:45:30.546 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' 1 -eq 1 ']' 2024-09-16T07:45:30.546 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' cls = ec_io ']' 2024-09-16T07:45:30.546 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' cls = ec_list ']' 2024-09-16T07:45:30.546 INFO:tasks.workunit.client.0.smithi121.stderr:+ ceph_test_neorados_cls 2024-09-16T07:45:30.567 INFO:tasks.workunit.client.0.smithi121.stdout:Running main() from gmock_main.cc 2024-09-16T07:45:30.568 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] Running 1 test from 1 test suite. 2024-09-16T07:45:30.568 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment set-up. 2024-09-16T07:45:30.568 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 1 test from NeoRadosCls 2024-09-16T07:45:30.568 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] NeoRadosCls.DNE 2024-09-16T07:45:33.566 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] NeoRadosCls.DNE (2998 ms) 2024-09-16T07:45:33.566 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 1 test from NeoRadosCls (2998 ms total) 2024-09-16T07:45:33.566 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:45:33.566 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment tear-down 2024-09-16T07:45:33.566 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] 1 test from 1 test suite ran. (2998 ms total) 2024-09-16T07:45:33.566 INFO:tasks.workunit.client.0.smithi121.stdout:[ PASSED ] 1 test. 2024-09-16T07:45:33.569 INFO:tasks.workunit.client.0.smithi121.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-16T07:45:33.569 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T07:45:33.569 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' 1 -eq 1 ']' 2024-09-16T07:45:33.569 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' cmd = ec_io ']' 2024-09-16T07:45:33.569 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' cmd = ec_list ']' 2024-09-16T07:45:33.569 INFO:tasks.workunit.client.0.smithi121.stderr:+ ceph_test_neorados_cmd 2024-09-16T07:45:33.589 INFO:tasks.workunit.client.0.smithi121.stdout:Running main() from gmock_main.cc 2024-09-16T07:45:33.589 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] Running 3 tests from 1 test suite. 2024-09-16T07:45:33.589 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment set-up. 2024-09-16T07:45:33.589 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 3 tests from NeoRadosCmd 2024-09-16T07:45:33.589 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] NeoRadosCmd.MonDescribe 2024-09-16T07:45:35.566 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] NeoRadosCmd.MonDescribe (1977 ms) 2024-09-16T07:45:35.566 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] NeoRadosCmd.OSDCmd 2024-09-16T07:45:37.574 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] NeoRadosCmd.OSDCmd (2008 ms) 2024-09-16T07:45:37.575 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] NeoRadosCmd.PGCmd 2024-09-16T07:45:40.590 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] NeoRadosCmd.PGCmd (3016 ms) 2024-09-16T07:45:40.590 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 3 tests from NeoRadosCmd (7001 ms total) 2024-09-16T07:45:40.591 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:45:40.591 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment tear-down 2024-09-16T07:45:40.591 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] 3 tests from 1 test suite ran. (7001 ms total) 2024-09-16T07:45:40.591 INFO:tasks.workunit.client.0.smithi121.stdout:[ PASSED ] 3 tests. 2024-09-16T07:45:40.593 INFO:tasks.workunit.client.0.smithi121.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-16T07:45:40.594 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T07:45:40.594 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' 1 -eq 1 ']' 2024-09-16T07:45:40.594 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' handler_error = ec_io ']' 2024-09-16T07:45:40.594 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' handler_error = ec_list ']' 2024-09-16T07:45:40.594 INFO:tasks.workunit.client.0.smithi121.stderr:+ ceph_test_neorados_handler_error 2024-09-16T07:45:40.613 INFO:tasks.workunit.client.0.smithi121.stdout:Running main() from gmock_main.cc 2024-09-16T07:45:40.613 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] Running 1 test from 1 test suite. 2024-09-16T07:45:40.613 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment set-up. 2024-09-16T07:45:40.613 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 1 test from neocls_handler_error 2024-09-16T07:45:40.613 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] neocls_handler_error.test_handler_error 2024-09-16T07:45:43.420 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] neocls_handler_error.test_handler_error (2808 ms) 2024-09-16T07:45:43.420 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 1 test from neocls_handler_error (2808 ms total) 2024-09-16T07:45:43.421 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:45:43.421 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment tear-down 2024-09-16T07:45:43.421 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] 1 test from 1 test suite ran. (2808 ms total) 2024-09-16T07:45:43.421 INFO:tasks.workunit.client.0.smithi121.stdout:[ PASSED ] 1 test. 2024-09-16T07:45:43.423 INFO:tasks.workunit.client.0.smithi121.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-16T07:45:43.423 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T07:45:43.423 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' 1 -eq 1 ']' 2024-09-16T07:45:43.423 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' io = ec_io ']' 2024-09-16T07:45:43.423 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' io = ec_list ']' 2024-09-16T07:45:43.423 INFO:tasks.workunit.client.0.smithi121.stderr:+ ceph_test_neorados_io 2024-09-16T07:45:43.446 INFO:tasks.workunit.client.0.smithi121.stdout:Running main() from gmock_main.cc 2024-09-16T07:45:43.446 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] Running 14 tests from 1 test suite. 2024-09-16T07:45:43.446 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment set-up. 2024-09-16T07:45:43.446 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 14 tests from NeoRadosIo 2024-09-16T07:45:43.446 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] NeoRadosIo.Limits 2024-09-16T07:45:44.424 INFO:tasks.workunit.client.0.smithi121.stderr:Not supported by crimson yet. Skipped 2024-09-16T07:45:45.428 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] NeoRadosIo.Limits (1982 ms) 2024-09-16T07:45:45.428 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] NeoRadosIo.SimpleWrite 2024-09-16T07:45:48.439 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] NeoRadosIo.SimpleWrite (3011 ms) 2024-09-16T07:45:48.440 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] NeoRadosIo.ReadOp 2024-09-16T07:45:51.460 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] NeoRadosIo.ReadOp (3021 ms) 2024-09-16T07:45:51.460 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] NeoRadosIo.SparseRead 2024-09-16T07:45:54.474 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] NeoRadosIo.SparseRead (3014 ms) 2024-09-16T07:45:54.474 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] NeoRadosIo.RoundTrip 2024-09-16T07:45:57.415 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] NeoRadosIo.RoundTrip (2941 ms) 2024-09-16T07:45:57.416 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] NeoRadosIo.ReadIntoBuufferlist 2024-09-16T07:46:00.495 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] NeoRadosIo.ReadIntoBuufferlist (3080 ms) 2024-09-16T07:46:00.495 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] NeoRadosIo.OverlappingWriteRoundTrip 2024-09-16T07:46:03.508 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] NeoRadosIo.OverlappingWriteRoundTrip (3013 ms) 2024-09-16T07:46:03.508 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] NeoRadosIo.WriteFullRoundTrip 2024-09-16T07:46:06.530 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] NeoRadosIo.WriteFullRoundTrip (3022 ms) 2024-09-16T07:46:06.531 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] NeoRadosIo.AppendRoundTrip 2024-09-16T07:46:09.429 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] NeoRadosIo.AppendRoundTrip (2899 ms) 2024-09-16T07:46:09.430 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] NeoRadosIo.Trunc 2024-09-16T07:46:12.445 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] NeoRadosIo.Trunc (3015 ms) 2024-09-16T07:46:12.445 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] NeoRadosIo.Remove 2024-09-16T07:46:15.455 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] NeoRadosIo.Remove (3011 ms) 2024-09-16T07:46:15.455 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] NeoRadosIo.XattrsRoundTrip 2024-09-16T07:46:18.465 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] NeoRadosIo.XattrsRoundTrip (3010 ms) 2024-09-16T07:46:18.465 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] NeoRadosIo.RmXattr 2024-09-16T07:46:21.481 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] NeoRadosIo.RmXattr (3016 ms) 2024-09-16T07:46:21.482 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] NeoRadosIo.GetXattrs 2024-09-16T07:46:24.491 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] NeoRadosIo.GetXattrs (3010 ms) 2024-09-16T07:46:24.492 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 14 tests from NeoRadosIo (41045 ms total) 2024-09-16T07:46:24.492 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:46:24.492 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment tear-down 2024-09-16T07:46:24.492 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] 14 tests from 1 test suite ran. (41045 ms total) 2024-09-16T07:46:24.492 INFO:tasks.workunit.client.0.smithi121.stdout:[ PASSED ] 14 tests. 2024-09-16T07:46:24.496 INFO:tasks.workunit.client.0.smithi121.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-16T07:46:24.496 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T07:46:24.497 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' 1 -eq 1 ']' 2024-09-16T07:46:24.497 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' ec_io = ec_io ']' 2024-09-16T07:46:24.497 INFO:tasks.workunit.client.0.smithi121.stderr:+ echo 'Skipping EC with Crimson' 2024-09-16T07:46:24.497 INFO:tasks.workunit.client.0.smithi121.stdout:Skipping EC with Crimson 2024-09-16T07:46:24.497 INFO:tasks.workunit.client.0.smithi121.stderr:+ continue 2024-09-16T07:46:24.498 INFO:tasks.workunit.client.0.smithi121.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-16T07:46:24.498 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T07:46:24.498 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' 1 -eq 1 ']' 2024-09-16T07:46:24.498 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' list = ec_io ']' 2024-09-16T07:46:24.498 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' list = ec_list ']' 2024-09-16T07:46:24.498 INFO:tasks.workunit.client.0.smithi121.stderr:+ ceph_test_neorados_list 2024-09-16T07:46:24.519 INFO:tasks.workunit.client.0.smithi121.stdout:Running main() from gmock_main.cc 2024-09-16T07:46:24.519 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] Running 3 tests from 1 test suite. 2024-09-16T07:46:24.519 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment set-up. 2024-09-16T07:46:24.519 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 3 tests from NeoradosList 2024-09-16T07:46:24.519 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] NeoradosList.ListObjects 2024-09-16T07:46:27.424 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] NeoradosList.ListObjects (2905 ms) 2024-09-16T07:46:27.425 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] NeoradosList.ListObjectsNS 2024-09-16T07:46:30.516 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] NeoradosList.ListObjectsNS (3092 ms) 2024-09-16T07:46:30.517 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] NeoradosList.ListObjectsMany 2024-09-16T07:46:39.540 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] NeoradosList.ListObjectsMany (9023 ms) 2024-09-16T07:46:39.540 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 3 tests from NeoradosList (15020 ms total) 2024-09-16T07:46:39.540 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:46:39.540 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment tear-down 2024-09-16T07:46:39.541 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] 3 tests from 1 test suite ran. (15020 ms total) 2024-09-16T07:46:39.541 INFO:tasks.workunit.client.0.smithi121.stdout:[ PASSED ] 3 tests. 2024-09-16T07:46:39.542 INFO:tasks.workunit.client.0.smithi121.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-16T07:46:39.542 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T07:46:39.542 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' 1 -eq 1 ']' 2024-09-16T07:46:39.542 INFO:tasks.workunit.client.0.smithi121.stdout:Skipping EC with Crimson 2024-09-16T07:46:39.543 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' ec_list = ec_io ']' 2024-09-16T07:46:39.543 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' ec_list = ec_list ']' 2024-09-16T07:46:39.543 INFO:tasks.workunit.client.0.smithi121.stderr:+ echo 'Skipping EC with Crimson' 2024-09-16T07:46:39.543 INFO:tasks.workunit.client.0.smithi121.stderr:+ continue 2024-09-16T07:46:39.543 INFO:tasks.workunit.client.0.smithi121.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-16T07:46:39.544 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T07:46:39.544 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' 1 -eq 1 ']' 2024-09-16T07:46:39.544 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' misc = ec_io ']' 2024-09-16T07:46:39.544 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' misc = ec_list ']' 2024-09-16T07:46:39.544 INFO:tasks.workunit.client.0.smithi121.stderr:+ ceph_test_neorados_misc 2024-09-16T07:46:39.562 INFO:tasks.workunit.client.0.smithi121.stdout:Running main() from gmock_main.cc 2024-09-16T07:46:39.562 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] Running 12 tests from 1 test suite. 2024-09-16T07:46:39.562 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment set-up. 2024-09-16T07:46:39.562 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 12 tests from NeoRadosMisc 2024-09-16T07:46:39.562 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] NeoRadosMisc.Version 2024-09-16T07:46:41.549 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] NeoRadosMisc.Version (1987 ms) 2024-09-16T07:46:41.549 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] NeoRadosMisc.WaitOSDMap 2024-09-16T07:46:43.427 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] NeoRadosMisc.WaitOSDMap (1878 ms) 2024-09-16T07:46:43.427 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] NeoRadosMisc.LongName 2024-09-16T07:46:46.438 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] NeoRadosMisc.LongName (3011 ms) 2024-09-16T07:46:46.438 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] NeoRadosMisc.LongLocator 2024-09-16T07:46:47.448 INFO:tasks.workunit.client.0.smithi121.stderr:Not supported by crimson yet. Skipped 2024-09-16T07:46:48.449 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] NeoRadosMisc.LongLocator (2011 ms) 2024-09-16T07:46:48.450 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] NeoRadosMisc.LongNamespace 2024-09-16T07:46:51.464 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] NeoRadosMisc.LongNamespace (3015 ms) 2024-09-16T07:46:51.465 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] NeoRadosMisc.LongAttrName 2024-09-16T07:46:54.467 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] NeoRadosMisc.LongAttrName (3003 ms) 2024-09-16T07:46:54.467 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] NeoRadosMisc.Exec 2024-09-16T07:46:57.484 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] NeoRadosMisc.Exec (3017 ms) 2024-09-16T07:46:57.484 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] NeoRadosMisc.Operate1 2024-09-16T07:47:00.494 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] NeoRadosMisc.Operate1 (3010 ms) 2024-09-16T07:47:00.494 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] NeoRadosMisc.Operate2 2024-09-16T07:47:03.505 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] NeoRadosMisc.Operate2 (3011 ms) 2024-09-16T07:47:03.505 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] NeoRadosMisc.BigObject 2024-09-16T07:47:06.517 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] NeoRadosMisc.BigObject (3012 ms) 2024-09-16T07:47:06.517 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] NeoRadosMisc.BigAttr 2024-09-16T07:47:08.529 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] NeoRadosMisc.BigAttr (2012 ms) 2024-09-16T07:47:08.529 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] NeoRadosMisc.WriteSame 2024-09-16T07:47:09.536 INFO:tasks.workunit.client.0.smithi121.stderr:Not supported by crimson yet. Skipped 2024-09-16T07:47:10.539 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] NeoRadosMisc.WriteSame (2010 ms) 2024-09-16T07:47:10.539 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 12 tests from NeoRadosMisc (30977 ms total) 2024-09-16T07:47:10.539 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:47:10.539 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment tear-down 2024-09-16T07:47:10.539 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] 12 tests from 1 test suite ran. (30977 ms total) 2024-09-16T07:47:10.540 INFO:tasks.workunit.client.0.smithi121.stdout:[ PASSED ] 12 tests. 2024-09-16T07:47:10.544 INFO:tasks.workunit.client.0.smithi121.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-16T07:47:10.544 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T07:47:10.545 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' 1 -eq 1 ']' 2024-09-16T07:47:10.545 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' pool = ec_io ']' 2024-09-16T07:47:10.545 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' pool = ec_list ']' 2024-09-16T07:47:10.545 INFO:tasks.workunit.client.0.smithi121.stderr:+ ceph_test_neorados_pool 2024-09-16T07:47:10.572 INFO:tasks.workunit.client.0.smithi121.stdout:Running main() from gmock_main.cc 2024-09-16T07:47:10.572 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] Running 6 tests from 1 test suite. 2024-09-16T07:47:10.572 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment set-up. 2024-09-16T07:47:10.572 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 6 tests from NeoRadosPools 2024-09-16T07:47:10.572 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] NeoRadosPools.PoolList 2024-09-16T07:47:12.435 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] NeoRadosPools.PoolList (1863 ms) 2024-09-16T07:47:12.435 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] NeoRadosPools.PoolLookup 2024-09-16T07:47:14.444 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] NeoRadosPools.PoolLookup (2009 ms) 2024-09-16T07:47:14.445 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] NeoRadosPools.PoolLookupOtherInstance 2024-09-16T07:47:16.456 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] NeoRadosPools.PoolLookupOtherInstance (2012 ms) 2024-09-16T07:47:16.457 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] NeoRadosPools.PoolDelete 2024-09-16T07:47:20.475 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] NeoRadosPools.PoolDelete (4018 ms) 2024-09-16T07:47:20.475 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] NeoRadosPools.PoolCreateDelete 2024-09-16T07:47:22.438 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] NeoRadosPools.PoolCreateDelete (1964 ms) 2024-09-16T07:47:22.438 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] NeoRadosPools.PoolCreateWithCrushRule 2024-09-16T07:47:24.448 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] NeoRadosPools.PoolCreateWithCrushRule (2010 ms) 2024-09-16T07:47:24.448 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 6 tests from NeoRadosPools (13876 ms total) 2024-09-16T07:47:24.448 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:47:24.448 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment tear-down 2024-09-16T07:47:24.448 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] 6 tests from 1 test suite ran. (13876 ms total) 2024-09-16T07:47:24.448 INFO:tasks.workunit.client.0.smithi121.stdout:[ PASSED ] 6 tests. 2024-09-16T07:47:24.452 INFO:tasks.workunit.client.0.smithi121.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-16T07:47:24.452 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T07:47:24.452 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' 1 -eq 1 ']' 2024-09-16T07:47:24.452 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' read_operations = ec_io ']' 2024-09-16T07:47:24.453 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' read_operations = ec_list ']' 2024-09-16T07:47:24.453 INFO:tasks.workunit.client.0.smithi121.stderr:+ ceph_test_neorados_read_operations 2024-09-16T07:47:24.484 INFO:tasks.workunit.client.0.smithi121.stdout:Running main() from gmock_main.cc 2024-09-16T07:47:24.484 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] Running 14 tests from 1 test suite. 2024-09-16T07:47:24.484 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment set-up. 2024-09-16T07:47:24.484 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 14 tests from NeoRadosReadOps 2024-09-16T07:47:24.484 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] NeoRadosReadOps.SetOpFlags 2024-09-16T07:47:27.468 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] NeoRadosReadOps.SetOpFlags (2984 ms) 2024-09-16T07:47:27.468 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] NeoRadosReadOps.AssertExists 2024-09-16T07:47:30.480 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] NeoRadosReadOps.AssertExists (3012 ms) 2024-09-16T07:47:30.480 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] NeoRadosReadOps.AssertVersion 2024-09-16T07:47:33.489 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] NeoRadosReadOps.AssertVersion (3009 ms) 2024-09-16T07:47:33.489 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] NeoRadosReadOps.CmpXattr 2024-09-16T07:47:36.542 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] NeoRadosReadOps.CmpXattr (3053 ms) 2024-09-16T07:47:36.542 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] NeoRadosReadOps.Read 2024-09-16T07:47:39.559 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] NeoRadosReadOps.Read (3017 ms) 2024-09-16T07:47:39.559 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] NeoRadosReadOps.Checksum 2024-09-16T07:47:42.438 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] NeoRadosReadOps.Checksum (2879 ms) 2024-09-16T07:47:42.439 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] NeoRadosReadOps.RWOrderedRead 2024-09-16T07:47:45.459 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] NeoRadosReadOps.RWOrderedRead (3021 ms) 2024-09-16T07:47:45.459 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] NeoRadosReadOps.ShortRead 2024-09-16T07:47:48.473 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] NeoRadosReadOps.ShortRead (3014 ms) 2024-09-16T07:47:48.473 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] NeoRadosReadOps.Exec 2024-09-16T07:47:51.491 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] NeoRadosReadOps.Exec (3018 ms) 2024-09-16T07:47:51.491 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] NeoRadosReadOps.Stat 2024-09-16T07:47:54.492 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] NeoRadosReadOps.Stat (3001 ms) 2024-09-16T07:47:54.492 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] NeoRadosReadOps.Omap 2024-09-16T07:47:57.517 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] NeoRadosReadOps.Omap (3025 ms) 2024-09-16T07:47:57.517 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] NeoRadosReadOps.OmapNuls 2024-09-16T07:48:00.520 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] NeoRadosReadOps.OmapNuls (3003 ms) 2024-09-16T07:48:00.520 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] NeoRadosReadOps.GetXattrs 2024-09-16T07:48:03.538 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] NeoRadosReadOps.GetXattrs (3018 ms) 2024-09-16T07:48:03.538 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] NeoRadosReadOps.CmpExt 2024-09-16T07:48:06.589 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] NeoRadosReadOps.CmpExt (3051 ms) 2024-09-16T07:48:06.589 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 14 tests from NeoRadosReadOps (42105 ms total) 2024-09-16T07:48:06.589 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:48:06.589 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment tear-down 2024-09-16T07:48:06.590 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] 14 tests from 1 test suite ran. (42105 ms total) 2024-09-16T07:48:06.590 INFO:tasks.workunit.client.0.smithi121.stdout:[ PASSED ] 14 tests. 2024-09-16T07:48:06.596 INFO:tasks.workunit.client.0.smithi121.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-16T07:48:06.596 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T07:48:06.596 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' 1 -eq 1 ']' 2024-09-16T07:48:06.596 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' snapshots = ec_io ']' 2024-09-16T07:48:06.597 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' snapshots = ec_list ']' 2024-09-16T07:48:06.597 INFO:tasks.workunit.client.0.smithi121.stderr:+ ceph_test_neorados_snapshots 2024-09-16T07:48:06.620 INFO:tasks.workunit.client.0.smithi121.stdout:Running main() from gmock_main.cc 2024-09-16T07:48:06.620 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] Running 11 tests from 2 test suites. 2024-09-16T07:48:06.620 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment set-up. 2024-09-16T07:48:06.620 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 5 tests from NeoRadosSnapshots 2024-09-16T07:48:06.620 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] NeoRadosSnapshots.SnapList 2024-09-16T07:48:11.610 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] NeoRadosSnapshots.SnapList (4989 ms) 2024-09-16T07:48:11.610 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] NeoRadosSnapshots.SnapRemove 2024-09-16T07:48:16.462 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] NeoRadosSnapshots.SnapRemove (4853 ms) 2024-09-16T07:48:16.462 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] NeoRadosSnapshots.Rollback 2024-09-16T07:48:20.490 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] NeoRadosSnapshots.Rollback (4028 ms) 2024-09-16T07:48:20.491 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] NeoRadosSnapshots.SnapGetName 2024-09-16T07:48:25.506 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] NeoRadosSnapshots.SnapGetName (5016 ms) 2024-09-16T07:48:25.506 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] NeoRadosSnapshots.SnapCreateRemove 2024-09-16T07:48:32.452 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] NeoRadosSnapshots.SnapCreateRemove (6945 ms) 2024-09-16T07:48:32.452 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 5 tests from NeoRadosSnapshots (25831 ms total) 2024-09-16T07:48:32.452 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:48:32.453 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 6 tests from NeoRadosSelfManagedSnaps 2024-09-16T07:48:32.453 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] NeoRadosSelfManagedSnaps.Snap 2024-09-16T07:48:37.473 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] NeoRadosSelfManagedSnaps.Snap (5022 ms) 2024-09-16T07:48:37.473 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] NeoRadosSelfManagedSnaps.Rollback 2024-09-16T07:48:38.477 INFO:tasks.workunit.client.0.smithi121.stderr:Not supported by crimson yet. Skipped 2024-09-16T07:48:39.482 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] NeoRadosSelfManagedSnaps.Rollback (2009 ms) 2024-09-16T07:48:39.482 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] NeoRadosSelfManagedSnaps.SnapOverlap 2024-09-16T07:48:40.487 INFO:tasks.workunit.client.0.smithi121.stderr:Not supported by crimson yet. Skipped 2024-09-16T07:48:41.491 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] NeoRadosSelfManagedSnaps.SnapOverlap (2009 ms) 2024-09-16T07:48:41.491 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] NeoRadosSelfManagedSnaps.Bug11677 2024-09-16T07:48:47.506 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] NeoRadosSelfManagedSnaps.Bug11677 (6015 ms) 2024-09-16T07:48:47.507 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] NeoRadosSelfManagedSnaps.OrderSnap 2024-09-16T07:48:51.528 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] NeoRadosSelfManagedSnaps.OrderSnap (4022 ms) 2024-09-16T07:48:51.529 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] NeoRadosSelfManagedSnaps.ReusePurgedSnap 2024-09-16T07:48:54.530 INFO:tasks.workunit.client.0.smithi121.stdout:Deleting snap 3 in pool ReusePurgedSnapsmithi121-95466-11. 2024-09-16T07:48:55.533 INFO:tasks.workunit.client.0.smithi121.stdout:Waiting for snaps to purge. 2024-09-16T07:49:11.471 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] NeoRadosSelfManagedSnaps.ReusePurgedSnap (19943 ms) 2024-09-16T07:49:11.472 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 6 tests from NeoRadosSelfManagedSnaps (39020 ms total) 2024-09-16T07:49:11.472 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:49:11.472 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment tear-down 2024-09-16T07:49:11.472 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] 11 tests from 2 test suites ran. (64851 ms total) 2024-09-16T07:49:11.472 INFO:tasks.workunit.client.0.smithi121.stdout:[ PASSED ] 11 tests. 2024-09-16T07:49:11.475 INFO:tasks.workunit.client.0.smithi121.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-16T07:49:11.475 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T07:49:11.475 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' 1 -eq 1 ']' 2024-09-16T07:49:11.476 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' watch_notify = ec_io ']' 2024-09-16T07:49:11.476 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' watch_notify = ec_list ']' 2024-09-16T07:49:11.476 INFO:tasks.workunit.client.0.smithi121.stderr:+ ceph_test_neorados_watch_notify 2024-09-16T07:49:11.498 INFO:tasks.workunit.client.0.smithi121.stdout:Running main() from gmock_main.cc 2024-09-16T07:49:11.498 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] Running 2 tests from 1 test suite. 2024-09-16T07:49:11.498 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment set-up. 2024-09-16T07:49:11.498 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 2 tests from NeoRadosWatchNotify 2024-09-16T07:49:11.498 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] NeoRadosWatchNotify.WatchNotify 2024-09-16T07:49:13.773 INFO:tasks.workunit.client.0.smithi121.stdout:handle_notify cookie 12864480 notify_id 2851858284553 notifier_gid 15914 2024-09-16T07:49:14.480 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] NeoRadosWatchNotify.WatchNotify (2982 ms) 2024-09-16T07:49:14.480 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] NeoRadosWatchNotify.WatchNotifyTimeout 2024-09-16T07:49:16.863 INFO:tasks.workunit.client.0.smithi121.stdout:Trying... 2024-09-16T07:49:16.866 INFO:tasks.workunit.client.0.smithi121.stdout:handle_notify cookie 24694432 notify_id 2864743186436 notifier_gid 15917 2024-09-16T07:49:16.867 INFO:tasks.workunit.client.0.smithi121.stdout:Waiting for 3.000000000s 2024-09-16T07:49:17.865 INFO:tasks.workunit.client.0.smithi121.stdout:Timed out. 2024-09-16T07:49:17.877 INFO:tasks.workunit.client.0.smithi121.stdout:Flushing... 2024-09-16T07:49:17.877 INFO:tasks.workunit.client.0.smithi121.stdout:Flushed... 2024-09-16T07:49:21.505 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] NeoRadosWatchNotify.WatchNotifyTimeout (7024 ms) 2024-09-16T07:49:21.505 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 2 tests from NeoRadosWatchNotify (10006 ms total) 2024-09-16T07:49:21.505 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:49:21.505 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment tear-down 2024-09-16T07:49:21.505 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] 2 tests from 1 test suite ran. (10006 ms total) 2024-09-16T07:49:21.505 INFO:tasks.workunit.client.0.smithi121.stdout:[ PASSED ] 2 tests. 2024-09-16T07:49:21.508 INFO:tasks.workunit.client.0.smithi121.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-16T07:49:21.508 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T07:49:21.508 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' 1 -eq 1 ']' 2024-09-16T07:49:21.508 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' write_operations = ec_io ']' 2024-09-16T07:49:21.508 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' write_operations = ec_list ']' 2024-09-16T07:49:21.508 INFO:tasks.workunit.client.0.smithi121.stderr:+ ceph_test_neorados_write_operations 2024-09-16T07:49:21.530 INFO:tasks.workunit.client.0.smithi121.stdout:Running main() from gmock_main.cc 2024-09-16T07:49:21.530 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-16T07:49:21.530 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment set-up. 2024-09-16T07:49:21.530 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 7 tests from NeoRadosWriteOps 2024-09-16T07:49:21.531 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] NeoRadosWriteOps.AssertExists 2024-09-16T07:49:24.519 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] NeoRadosWriteOps.AssertExists (2988 ms) 2024-09-16T07:49:24.519 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] NeoRadosWriteOps.AssertVersion 2024-09-16T07:49:27.541 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] NeoRadosWriteOps.AssertVersion (3023 ms) 2024-09-16T07:49:27.541 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] NeoRadosWriteOps.Xattrs 2024-09-16T07:49:30.547 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] NeoRadosWriteOps.Xattrs (3006 ms) 2024-09-16T07:49:30.548 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] NeoRadosWriteOps.Write 2024-09-16T07:49:33.565 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] NeoRadosWriteOps.Write (3017 ms) 2024-09-16T07:49:33.565 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] NeoRadosWriteOps.Exec 2024-09-16T07:49:36.577 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] NeoRadosWriteOps.Exec (3013 ms) 2024-09-16T07:49:36.577 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] NeoRadosWriteOps.WriteSame 2024-09-16T07:49:39.478 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] NeoRadosWriteOps.WriteSame (2901 ms) 2024-09-16T07:49:39.478 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] NeoRadosWriteOps.CmpExt 2024-09-16T07:49:50.494 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] NeoRadosWriteOps.CmpExt (11016 ms) 2024-09-16T07:49:50.494 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 7 tests from NeoRadosWriteOps (28964 ms total) 2024-09-16T07:49:50.494 INFO:tasks.workunit.client.0.smithi121.stdout: 2024-09-16T07:49:50.494 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment tear-down 2024-09-16T07:49:50.494 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] 7 tests from 1 test suite ran. (28964 ms total) 2024-09-16T07:49:50.494 INFO:tasks.workunit.client.0.smithi121.stdout:[ PASSED ] 7 tests. 2024-09-16T07:49:50.497 INFO:tasks.workunit.client.0.smithi121.stderr:+ ret=0 2024-09-16T07:49:50.497 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' 0 -eq 1 ']' 2024-09-16T07:49:50.497 INFO:tasks.workunit.client.0.smithi121.stderr:+ exit 0 2024-09-16T07:49:50.497 INFO:tasks.workunit.client.0.smithi121.stderr:+ cleanup 2024-09-16T07:49:50.497 INFO:tasks.workunit.client.0.smithi121.stderr:+ pkill -P 29893 2024-09-16T07:49:50.516 INFO:tasks.workunit.client.0.smithi121.stderr:+ true 2024-09-16T07:49:50.516 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-16T07:49:50.517 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-16T07:49:50.596 INFO:tasks.workunit:Running workunits matching rados/test_pool_quota.sh on client.0... 2024-09-16T07:49:50.597 INFO:tasks.workunit:Running workunit rados/test_pool_quota.sh... 2024-09-16T07:49:50.597 DEBUG:teuthology.orchestra.run.smithi121:workunit test rados/test_pool_quota.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0325fd3c11a225c0fd9eb38fab88aad1370ad779 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_pool_quota.sh 2024-09-16T07:49:50.658 INFO:tasks.workunit.client.0.smithi121.stderr:++ uuidgen 2024-09-16T07:49:50.674 INFO:tasks.workunit.client.0.smithi121.stderr:+ p=989b9542-ea3d-4c5c-8f96-23ff25b76fb1 2024-09-16T07:49:50.674 INFO:tasks.workunit.client.0.smithi121.stderr:+ ceph osd pool create 989b9542-ea3d-4c5c-8f96-23ff25b76fb1 12 2024-09-16T07:49:50.807 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:50.797+0000 7fbc0f151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:50.808 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:50.808+0000 7fbc0f151640 1 Processor -- start 2024-09-16T07:49:50.808 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:50.808+0000 7fbc0f151640 1 -- start start 2024-09-16T07:49:50.809 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:50.809+0000 7fbc0f151640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fbc0809ecc0 0x7fbc0806ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:49:50.809 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:50.809+0000 7fbc0f151640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc0809fa40 con 0x7fbc0806f120 2024-09-16T07:49:50.809 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:50.809+0000 7fbc0f151640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fbc0809fd50 con 0x7fbc0809ecc0 2024-09-16T07:49:50.810 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:50.810+0000 7fbc0ceed640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fbc0809ecc0 0x7fbc0806ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:49:50.810 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:50.810+0000 7fbc0ceed640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fbc0809ecc0 0x7fbc0806ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42834/0 (socket says 172.21.15.121:42834) 2024-09-16T07:49:50.810 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:50.810+0000 7fbc0ceed640 1 -- 172.21.15.121:0/62917417 learned_addr learned my addr 172.21.15.121:0/62917417 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:49:50.810 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:50.810+0000 7fbc0ceed640 1 -- 172.21.15.121:0/62917417 >> v1:172.21.15.121:6789/0 conn(0x7fbc0806f120 legacy=0x7fbc08135e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:49:50.811 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:50.810+0000 7fbc0ceed640 1 -- 172.21.15.121:0/62917417 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc0809ff70 con 0x7fbc0809ecc0 2024-09-16T07:49:50.811 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:50.810+0000 7fbc0ceed640 1 --2- 172.21.15.121:0/62917417 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc0809ecc0 0x7fbc0806ebe0 crc :-1 s=READY pgs=12851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b5aa6ecaba1a059 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:49:50.811 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:50.810+0000 7fbc077fe640 1 -- 172.21.15.121:0/62917417 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbbfc009e50 con 0x7fbc0809ecc0 2024-09-16T07:49:50.811 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:50.810+0000 7fbc077fe640 1 -- 172.21.15.121:0/62917417 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fbbfc00e230 con 0x7fbc0809ecc0 2024-09-16T07:49:50.811 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:50.810+0000 7fbc077fe640 1 -- 172.21.15.121:0/62917417 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbbfc00e4d0 con 0x7fbc0809ecc0 2024-09-16T07:49:50.812 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:50.811+0000 7fbc0f151640 1 -- 172.21.15.121:0/62917417 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc0809ecc0 msgr2=0x7fbc0806ebe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:49:50.812 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:50.811+0000 7fbc0f151640 1 --2- 172.21.15.121:0/62917417 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc0809ecc0 0x7fbc0806ebe0 crc :-1 s=READY pgs=12851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:50.812 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:50.811+0000 7fbc0f151640 1 -- 172.21.15.121:0/62917417 shutdown_connections 2024-09-16T07:49:50.812 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:50.811+0000 7fbc0f151640 1 --2- 172.21.15.121:0/62917417 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc0809ecc0 0x7fbc0806ebe0 unknown :-1 s=CLOSED pgs=12851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:50.812 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:50.812+0000 7fbc0f151640 1 -- 172.21.15.121:0/62917417 >> 172.21.15.121:0/62917417 conn(0x7fbc080a5350 msgr2=0x7fbc080a5760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:49:50.812 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:50.812+0000 7fbc0f151640 1 -- 172.21.15.121:0/62917417 shutdown_connections 2024-09-16T07:49:50.813 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:50.812+0000 7fbc0f151640 1 -- 172.21.15.121:0/62917417 wait complete. 2024-09-16T07:49:50.813 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:50.812+0000 7fbc0f151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:50.813 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:50.813+0000 7fbc0f151640 1 Processor -- start 2024-09-16T07:49:50.813 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:50.813+0000 7fbc0f151640 1 -- start start 2024-09-16T07:49:50.814 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:50.816+0000 7fbc0f151640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc0806f120 0x7fbc08135a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:49:50.815 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:50.816+0000 7fbc0f151640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbc08125b00 con 0x7fbc0806f120 2024-09-16T07:49:50.815 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:50.816+0000 7fbc0ceed640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc0806f120 0x7fbc08135a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:49:50.815 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:50.816+0000 7fbc0ceed640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc0806f120 0x7fbc08135a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42840/0 (socket says 172.21.15.121:42840) 2024-09-16T07:49:50.815 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:50.816+0000 7fbc0ceed640 1 -- 172.21.15.121:0/2981478129 learned_addr learned my addr 172.21.15.121:0/2981478129 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:49:50.816 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:50.816+0000 7fbc0ceed640 1 -- 172.21.15.121:0/2981478129 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc08136120 con 0x7fbc0806f120 2024-09-16T07:49:50.816 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:50.816+0000 7fbc0ceed640 1 --2- 172.21.15.121:0/2981478129 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc0806f120 0x7fbc08135a20 crc :-1 s=READY pgs=12852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:49:50.816 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:50.816+0000 7fbc057fa640 1 -- 172.21.15.121:0/2981478129 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbbfc00eda0 con 0x7fbc0806f120 2024-09-16T07:49:50.816 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:50.817+0000 7fbc057fa640 1 -- 172.21.15.121:0/2981478129 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fbbfc015420 con 0x7fbc0806f120 2024-09-16T07:49:50.816 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:50.817+0000 7fbc0f151640 1 -- 172.21.15.121:0/2981478129 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc08122e30 con 0x7fbc0806f120 2024-09-16T07:49:50.816 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:50.817+0000 7fbc057fa640 1 -- 172.21.15.121:0/2981478129 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbbfc0156c0 con 0x7fbc0806f120 2024-09-16T07:49:50.816 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:50.817+0000 7fbc0f151640 1 -- 172.21.15.121:0/2981478129 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc08124330 con 0x7fbc0806f120 2024-09-16T07:49:50.817 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:50.818+0000 7fbc0f151640 1 -- 172.21.15.121:0/2981478129 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc0809e2b0 con 0x7fbc0806f120 2024-09-16T07:49:50.817 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:50.818+0000 7fbc057fa640 1 -- 172.21.15.121:0/2981478129 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fbbfc015870 con 0x7fbc0806f120 2024-09-16T07:49:50.817 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:50.818+0000 7fbc057fa640 1 --2- 172.21.15.121:0/2981478129 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fbbec03e930 0x7fbbec040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:49:50.817 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:50.818+0000 7fbc057fa640 1 -- 172.21.15.121:0/2981478129 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(692..692 src has 620..692) ==== 3431+0+0 (crc 0 0 0) 0x7fbbfc050d90 con 0x7fbc0806f120 2024-09-16T07:49:50.818 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:50.818+0000 7fbc07fff640 1 --2- 172.21.15.121:0/2981478129 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fbbec03e930 0x7fbbec040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:49:50.818 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:50.818+0000 7fbc07fff640 1 --2- 172.21.15.121:0/2981478129 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fbbec03e930 0x7fbbec040e40 crc :-1 s=READY pgs=3805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:49:50.827 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:50.827+0000 7fbc057fa640 1 -- 172.21.15.121:0/2981478129 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fbbfc014c60 con 0x7fbc0806f120 2024-09-16T07:49:51.009 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:51.010+0000 7fbc0f151640 1 -- 172.21.15.121:0/2981478129 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "989b9542-ea3d-4c5c-8f96-23ff25b76fb1", "pg_num": 12} v 0) -- 0x7fbc08136120 con 0x7fbc0806f120 2024-09-16T07:49:51.499 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:51.500+0000 7fbc057fa640 1 -- 172.21.15.121:0/2981478129 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "989b9542-ea3d-4c5c-8f96-23ff25b76fb1", "pg_num": 12}]=0 pool '989b9542-ea3d-4c5c-8f96-23ff25b76fb1' created v693) ==== 176+0+0 (crc 0 0 0) 0x7fbc08136120 con 0x7fbc0806f120 2024-09-16T07:49:51.628 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:51.629+0000 7fbc0f151640 1 -- 172.21.15.121:0/2981478129 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "989b9542-ea3d-4c5c-8f96-23ff25b76fb1", "pg_num": 12} v 0) -- 0x7fbc08136120 con 0x7fbc0806f120 2024-09-16T07:49:51.629 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:51.630+0000 7fbc057fa640 1 -- 172.21.15.121:0/2981478129 <== mon.0 v2:172.21.15.121:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "989b9542-ea3d-4c5c-8f96-23ff25b76fb1", "pg_num": 12}]=0 pool '989b9542-ea3d-4c5c-8f96-23ff25b76fb1' already exists v693) ==== 183+0+0 (crc 0 0 0) 0x7fbc08136120 con 0x7fbc0806f120 2024-09-16T07:49:51.629 INFO:tasks.workunit.client.0.smithi121.stderr:pool '989b9542-ea3d-4c5c-8f96-23ff25b76fb1' already exists 2024-09-16T07:49:51.631 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:51.632+0000 7fbc0f151640 1 -- 172.21.15.121:0/2981478129 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fbbec03e930 msgr2=0x7fbbec040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:49:51.631 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:51.632+0000 7fbc0f151640 1 --2- 172.21.15.121:0/2981478129 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fbbec03e930 0x7fbbec040e40 crc :-1 s=READY pgs=3805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:51.631 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:51.632+0000 7fbc0f151640 1 -- 172.21.15.121:0/2981478129 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc0806f120 msgr2=0x7fbc08135a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:49:51.631 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:51.632+0000 7fbc0f151640 1 --2- 172.21.15.121:0/2981478129 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc0806f120 0x7fbc08135a20 crc :-1 s=READY pgs=12852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:51.632 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:51.632+0000 7fbc0f151640 1 -- 172.21.15.121:0/2981478129 shutdown_connections 2024-09-16T07:49:51.632 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:51.632+0000 7fbc0f151640 1 --2- 172.21.15.121:0/2981478129 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fbbec03e930 0x7fbbec040e40 unknown :-1 s=CLOSED pgs=3805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:51.632 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:51.632+0000 7fbc0f151640 1 --2- 172.21.15.121:0/2981478129 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc0806f120 0x7fbc08135a20 unknown :-1 s=CLOSED pgs=12852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:51.632 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:51.632+0000 7fbc0f151640 1 -- 172.21.15.121:0/2981478129 >> 172.21.15.121:0/2981478129 conn(0x7fbc080a5350 msgr2=0x7fbc080a7340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:49:51.632 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:51.632+0000 7fbc0f151640 1 -- 172.21.15.121:0/2981478129 shutdown_connections 2024-09-16T07:49:51.632 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:51.632+0000 7fbc0f151640 1 -- 172.21.15.121:0/2981478129 wait complete. 2024-09-16T07:49:51.640 INFO:tasks.workunit.client.0.smithi121.stderr:+ ceph osd pool set-quota 989b9542-ea3d-4c5c-8f96-23ff25b76fb1 max_objects 10 2024-09-16T07:49:51.734 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:51.726+0000 7fb006991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:51.735 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:51.736+0000 7fb006991640 1 Processor -- start 2024-09-16T07:49:51.735 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:51.736+0000 7fb006991640 1 -- start start 2024-09-16T07:49:51.737 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:51.737+0000 7fb006991640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fb00009c6a0 0x7fb00009cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:49:51.737 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:51.737+0000 7fb006991640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb00009eb70 con 0x7fb00009cff0 2024-09-16T07:49:51.737 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:51.737+0000 7fb006991640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fb000076180 con 0x7fb00009c6a0 2024-09-16T07:49:51.737 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:51.737+0000 7faffffff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fb00009c6a0 0x7fb00009cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:49:51.737 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:51.737+0000 7fafff7fe640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fb00009cff0 0x7fb0001332f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:45184/0 (socket says 172.21.15.121:45184) 2024-09-16T07:49:51.737 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:51.737+0000 7faffffff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fb00009c6a0 0x7fb00009cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42842/0 (socket says 172.21.15.121:42842) 2024-09-16T07:49:51.737 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:51.737+0000 7fafff7fe640 1 -- 172.21.15.121:0/2062956504 learned_addr learned my addr 172.21.15.121:0/2062956504 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-16T07:49:51.737 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:51.738+0000 7faffffff640 1 -- 172.21.15.121:0/2062956504 >> v1:172.21.15.121:6789/0 conn(0x7fb00009cff0 legacy=0x7fb0001332f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:49:51.738 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:51.738+0000 7faffeffd640 1 -- 172.21.15.121:0/2062956504 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2481409990 0 0) 0x7fb00009eb70 con 0x7fb00009cff0 2024-09-16T07:49:51.738 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:51.738+0000 7faffffff640 1 -- 172.21.15.121:0/2062956504 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb00009e290 con 0x7fb00009c6a0 2024-09-16T07:49:51.738 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:51.738+0000 7faffffff640 1 --2- 172.21.15.121:0/2062956504 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb00009c6a0 0x7fb00009cab0 crc :-1 s=READY pgs=12854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce3656c16a3afb server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:49:51.738 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:51.738+0000 7faffeffd640 1 -- 172.21.15.121:0/2062956504 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7faff0009d90 con 0x7fb00009c6a0 2024-09-16T07:49:51.738 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:51.738+0000 7faffeffd640 1 -- 172.21.15.121:0/2062956504 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7faff000e230 con 0x7fb00009c6a0 2024-09-16T07:49:51.738 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:51.738+0000 7faffeffd640 1 -- 172.21.15.121:0/2062956504 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7faff000e4d0 con 0x7fb00009c6a0 2024-09-16T07:49:51.739 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:51.739+0000 7fb006991640 1 -- 172.21.15.121:0/2062956504 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb00009c6a0 msgr2=0x7fb00009cab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:49:51.739 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:51.739+0000 7fb006991640 1 --2- 172.21.15.121:0/2062956504 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb00009c6a0 0x7fb00009cab0 crc :-1 s=READY pgs=12854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:51.739 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:51.739+0000 7fb006991640 1 -- 172.21.15.121:0/2062956504 shutdown_connections 2024-09-16T07:49:51.739 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:51.739+0000 7fb006991640 1 --2- 172.21.15.121:0/2062956504 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb00009c6a0 0x7fb00009cab0 unknown :-1 s=CLOSED pgs=12854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:51.739 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:51.739+0000 7fb006991640 1 -- 172.21.15.121:0/2062956504 >> 172.21.15.121:0/2062956504 conn(0x7fb0000a30a0 msgr2=0x7fb0000a34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:49:51.739 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:51.739+0000 7fb006991640 1 -- 172.21.15.121:0/2062956504 shutdown_connections 2024-09-16T07:49:51.739 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:51.739+0000 7fb006991640 1 -- 172.21.15.121:0/2062956504 wait complete. 2024-09-16T07:49:51.739 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:51.739+0000 7fb006991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:51.740 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:51.740+0000 7fb006991640 1 Processor -- start 2024-09-16T07:49:51.740 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:51.740+0000 7fb006991640 1 -- start start 2024-09-16T07:49:51.741 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:51.741+0000 7fb006991640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb00009c6a0 0x7fb000132350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:49:51.741 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:51.741+0000 7fb006991640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb000133d50 con 0x7fb00009c6a0 2024-09-16T07:49:51.741 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:51.741+0000 7faffffff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb00009c6a0 0x7fb000132350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:49:51.741 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:51.741+0000 7faffffff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb00009c6a0 0x7fb000132350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42856/0 (socket says 172.21.15.121:42856) 2024-09-16T07:49:51.741 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:51.742+0000 7faffffff640 1 -- 172.21.15.121:0/3366397104 learned_addr learned my addr 172.21.15.121:0/3366397104 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:49:51.741 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:51.742+0000 7faffffff640 1 -- 172.21.15.121:0/3366397104 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb000134010 con 0x7fb00009c6a0 2024-09-16T07:49:51.741 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:51.742+0000 7faffffff640 1 --2- 172.21.15.121:0/3366397104 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb00009c6a0 0x7fb000132350 crc :-1 s=READY pgs=12855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:49:51.742 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:51.742+0000 7faffcff9640 1 -- 172.21.15.121:0/3366397104 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7faff0013610 con 0x7fb00009c6a0 2024-09-16T07:49:51.742 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:51.742+0000 7faffcff9640 1 -- 172.21.15.121:0/3366397104 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7faff0013770 con 0x7fb00009c6a0 2024-09-16T07:49:51.742 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:51.742+0000 7fb006991640 1 -- 172.21.15.121:0/3366397104 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb00012fb50 con 0x7fb00009c6a0 2024-09-16T07:49:51.742 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:51.742+0000 7faffcff9640 1 -- 172.21.15.121:0/3366397104 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7faff0013a10 con 0x7fb00009c6a0 2024-09-16T07:49:51.742 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:51.742+0000 7fb006991640 1 -- 172.21.15.121:0/3366397104 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb000130970 con 0x7fb00009c6a0 2024-09-16T07:49:51.743 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:51.743+0000 7fb006991640 1 -- 172.21.15.121:0/3366397104 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb000051040 con 0x7fb00009c6a0 2024-09-16T07:49:51.743 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:51.743+0000 7faffcff9640 1 -- 172.21.15.121:0/3366397104 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7faff0013bc0 con 0x7fb00009c6a0 2024-09-16T07:49:51.743 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:51.743+0000 7faffcff9640 1 --2- 172.21.15.121:0/3366397104 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fafec03e930 0x7fafec040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:49:51.743 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:51.744+0000 7faffcff9640 1 -- 172.21.15.121:0/3366397104 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(693..693 src has 620..693) ==== 3806+0+0 (crc 0 0 0) 0x7faff0018040 con 0x7fb00009c6a0 2024-09-16T07:49:51.743 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:51.744+0000 7fafff7fe640 1 --2- 172.21.15.121:0/3366397104 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fafec03e930 0x7fafec040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:49:51.743 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:51.744+0000 7fafff7fe640 1 --2- 172.21.15.121:0/3366397104 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fafec03e930 0x7fafec040e40 crc :-1 s=READY pgs=3806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:49:51.748 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:51.749+0000 7faffcff9640 1 -- 172.21.15.121:0/3366397104 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7faff0011380 con 0x7fb00009c6a0 2024-09-16T07:49:51.925 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:51.926+0000 7fb006991640 1 -- 172.21.15.121:0/3366397104 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "989b9542-ea3d-4c5c-8f96-23ff25b76fb1", "field": "max_objects", "val": "10"} v 0) -- 0x7fb000131fa0 con 0x7fb00009c6a0 2024-09-16T07:49:52.506 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:52.507+0000 7faffcff9640 1 -- 172.21.15.121:0/3366397104 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "989b9542-ea3d-4c5c-8f96-23ff25b76fb1", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 989b9542-ea3d-4c5c-8f96-23ff25b76fb1 v694) ==== 223+0+0 (crc 0 0 0) 0x7faff0018a40 con 0x7fb00009c6a0 2024-09-16T07:49:52.664 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:52.665+0000 7fb006991640 1 -- 172.21.15.121:0/3366397104 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "989b9542-ea3d-4c5c-8f96-23ff25b76fb1", "field": "max_objects", "val": "10"} v 0) -- 0x7fb00009da90 con 0x7fb00009c6a0 2024-09-16T07:49:53.513 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:53.514+0000 7faffcff9640 1 -- 172.21.15.121:0/3366397104 <== mon.0 v2:172.21.15.121:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "989b9542-ea3d-4c5c-8f96-23ff25b76fb1", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 989b9542-ea3d-4c5c-8f96-23ff25b76fb1 v695) ==== 223+0+0 (crc 0 0 0) 0x7faff0017190 con 0x7fb00009c6a0 2024-09-16T07:49:53.513 INFO:tasks.workunit.client.0.smithi121.stderr:set-quota max_objects = 10 for pool 989b9542-ea3d-4c5c-8f96-23ff25b76fb1 2024-09-16T07:49:53.517 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:53.517+0000 7fb006991640 1 -- 172.21.15.121:0/3366397104 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fafec03e930 msgr2=0x7fafec040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:49:53.517 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:53.517+0000 7fb006991640 1 --2- 172.21.15.121:0/3366397104 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fafec03e930 0x7fafec040e40 crc :-1 s=READY pgs=3806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:53.517 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:53.518+0000 7fb006991640 1 -- 172.21.15.121:0/3366397104 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb00009c6a0 msgr2=0x7fb000132350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:49:53.517 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:53.518+0000 7fb006991640 1 --2- 172.21.15.121:0/3366397104 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb00009c6a0 0x7fb000132350 crc :-1 s=READY pgs=12855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:53.517 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:53.518+0000 7fb006991640 1 -- 172.21.15.121:0/3366397104 shutdown_connections 2024-09-16T07:49:53.517 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:53.518+0000 7fb006991640 1 --2- 172.21.15.121:0/3366397104 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fafec03e930 0x7fafec040e40 unknown :-1 s=CLOSED pgs=3806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:53.517 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:53.518+0000 7fb006991640 1 --2- 172.21.15.121:0/3366397104 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb00009c6a0 0x7fb000132350 unknown :-1 s=CLOSED pgs=12855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:53.517 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:53.518+0000 7fb006991640 1 -- 172.21.15.121:0/3366397104 >> 172.21.15.121:0/3366397104 conn(0x7fb0000a30a0 msgr2=0x7fb00009faa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:49:53.517 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:53.518+0000 7fb006991640 1 -- 172.21.15.121:0/3366397104 shutdown_connections 2024-09-16T07:49:53.518 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:53.518+0000 7fb006991640 1 -- 172.21.15.121:0/3366397104 wait complete. 2024-09-16T07:49:53.531 INFO:tasks.workunit.client.0.smithi121.stderr:+ ceph osd pool application enable 989b9542-ea3d-4c5c-8f96-23ff25b76fb1 rados 2024-09-16T07:49:53.638 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:53.631+0000 7fc41207f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:53.639 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:53.640+0000 7fc41207f640 1 Processor -- start 2024-09-16T07:49:53.639 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:53.640+0000 7fc41207f640 1 -- start start 2024-09-16T07:49:53.641 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:53.641+0000 7fc41207f640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fc40c09d1c0 0x7fc40c138530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:49:53.641 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:53.641+0000 7fc41207f640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc40c09eb70 con 0x7fc40c09c6a0 2024-09-16T07:49:53.641 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:53.641+0000 7fc41207f640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fc40c076180 con 0x7fc40c09d1c0 2024-09-16T07:49:53.642 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:53.642+0000 7fc40b7fe640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fc40c09c6a0 0x7fc40c09cab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:45186/0 (socket says 172.21.15.121:45186) 2024-09-16T07:49:53.642 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:53.642+0000 7fc40b7fe640 1 -- 172.21.15.121:0/2317506234 learned_addr learned my addr 172.21.15.121:0/2317506234 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-16T07:49:53.642 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:53.642+0000 7fc40affd640 1 --2- 172.21.15.121:0/2317506234 >> v2:172.21.15.121:3300/0 conn(0x7fc40c09d1c0 0x7fc40c138530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:49:53.642 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:53.642+0000 7fc40a7fc640 1 -- 172.21.15.121:0/2317506234 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2696335703 0 0) 0x7fc40c09eb70 con 0x7fc40c09c6a0 2024-09-16T07:49:53.642 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:53.642+0000 7fc40a7fc640 1 -- 172.21.15.121:0/2317506234 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3f4003580 con 0x7fc40c09c6a0 2024-09-16T07:49:53.642 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:53.642+0000 7fc40affd640 1 -- 172.21.15.121:0/2317506234 >> v1:172.21.15.121:6789/0 conn(0x7fc40c09c6a0 legacy=0x7fc40c09cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:49:53.642 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:53.642+0000 7fc40affd640 1 -- 172.21.15.121:0/2317506234 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc40c09e290 con 0x7fc40c09d1c0 2024-09-16T07:49:53.642 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:53.642+0000 7fc40affd640 1 --2- 172.21.15.121:0/2317506234 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc40c09d1c0 0x7fc40c138530 crc :-1 s=READY pgs=12857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=561ab6bf0f3def21 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:49:53.642 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:53.642+0000 7fc40a7fc640 1 -- 172.21.15.121:0/2317506234 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc400009d90 con 0x7fc40c09d1c0 2024-09-16T07:49:53.643 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:53.642+0000 7fc40a7fc640 1 -- 172.21.15.121:0/2317506234 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc40000e230 con 0x7fc40c09d1c0 2024-09-16T07:49:53.643 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:53.642+0000 7fc40a7fc640 1 -- 172.21.15.121:0/2317506234 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc40000e4d0 con 0x7fc40c09d1c0 2024-09-16T07:49:53.644 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:53.643+0000 7fc41207f640 1 -- 172.21.15.121:0/2317506234 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc40c09d1c0 msgr2=0x7fc40c138530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:49:53.644 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:53.643+0000 7fc41207f640 1 --2- 172.21.15.121:0/2317506234 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc40c09d1c0 0x7fc40c138530 crc :-1 s=READY pgs=12857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:53.644 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:53.643+0000 7fc41207f640 1 -- 172.21.15.121:0/2317506234 shutdown_connections 2024-09-16T07:49:53.644 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:53.643+0000 7fc41207f640 1 --2- 172.21.15.121:0/2317506234 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc40c09d1c0 0x7fc40c138530 unknown :-1 s=CLOSED pgs=12857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:53.644 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:53.643+0000 7fc41207f640 1 -- 172.21.15.121:0/2317506234 >> 172.21.15.121:0/2317506234 conn(0x7fc40c0a30a0 msgr2=0x7fc40c0a34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:49:53.644 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:53.643+0000 7fc41207f640 1 -- 172.21.15.121:0/2317506234 shutdown_connections 2024-09-16T07:49:53.644 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:53.643+0000 7fc41207f640 1 -- 172.21.15.121:0/2317506234 wait complete. 2024-09-16T07:49:53.644 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:53.644+0000 7fc41207f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:53.644 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:53.645+0000 7fc41207f640 1 Processor -- start 2024-09-16T07:49:53.644 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:53.645+0000 7fc41207f640 1 -- start start 2024-09-16T07:49:53.646 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:53.646+0000 7fc41207f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc40c09c6a0 0x7fc40c12eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:49:53.646 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:53.646+0000 7fc41207f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc40c12fb90 con 0x7fc40c09c6a0 2024-09-16T07:49:53.646 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:53.646+0000 7fc40b7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc40c09c6a0 0x7fc40c12eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:49:53.646 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:53.646+0000 7fc40b7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc40c09c6a0 0x7fc40c12eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42882/0 (socket says 172.21.15.121:42882) 2024-09-16T07:49:53.646 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:53.646+0000 7fc40b7fe640 1 -- 172.21.15.121:0/111870071 learned_addr learned my addr 172.21.15.121:0/111870071 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:49:53.646 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:53.646+0000 7fc40b7fe640 1 -- 172.21.15.121:0/111870071 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc40c12e790 con 0x7fc40c09c6a0 2024-09-16T07:49:53.646 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:53.647+0000 7fc40b7fe640 1 --2- 172.21.15.121:0/111870071 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc40c09c6a0 0x7fc40c12eb50 crc :-1 s=READY pgs=12858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:49:53.646 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:53.647+0000 7fc3f3fff640 1 -- 172.21.15.121:0/111870071 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc3fc0070b0 con 0x7fc40c09c6a0 2024-09-16T07:49:53.646 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:53.647+0000 7fc3f3fff640 1 -- 172.21.15.121:0/111870071 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc3fc007210 con 0x7fc40c09c6a0 2024-09-16T07:49:53.647 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:53.647+0000 7fc41207f640 1 -- 172.21.15.121:0/111870071 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc40c130120 con 0x7fc40c09c6a0 2024-09-16T07:49:53.647 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:53.647+0000 7fc3f3fff640 1 -- 172.21.15.121:0/111870071 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc3fc0074b0 con 0x7fc40c09c6a0 2024-09-16T07:49:53.647 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:53.647+0000 7fc41207f640 1 -- 172.21.15.121:0/111870071 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc40c131a90 con 0x7fc40c09c6a0 2024-09-16T07:49:53.648 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:53.648+0000 7fc41207f640 1 -- 172.21.15.121:0/111870071 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc40c051040 con 0x7fc40c09c6a0 2024-09-16T07:49:53.649 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:53.648+0000 7fc3f3fff640 1 -- 172.21.15.121:0/111870071 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fc3fc007610 con 0x7fc40c09c6a0 2024-09-16T07:49:53.649 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:53.648+0000 7fc3f3fff640 1 --2- 172.21.15.121:0/111870071 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fc3f803e930 0x7fc3f8040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:49:53.649 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:53.648+0000 7fc3f3fff640 1 -- 172.21.15.121:0/111870071 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(695..695 src has 620..695) ==== 3806+0+0 (crc 0 0 0) 0x7fc3fc050480 con 0x7fc40c09c6a0 2024-09-16T07:49:53.649 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:53.649+0000 7fc40affd640 1 --2- 172.21.15.121:0/111870071 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fc3f803e930 0x7fc3f8040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:49:53.649 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:53.649+0000 7fc40affd640 1 --2- 172.21.15.121:0/111870071 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fc3f803e930 0x7fc3f8040e40 crc :-1 s=READY pgs=3807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:49:53.652 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:53.654+0000 7fc3f3fff640 1 -- 172.21.15.121:0/111870071 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fc3fc0096b0 con 0x7fc40c09c6a0 2024-09-16T07:49:53.829 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:53.830+0000 7fc41207f640 1 -- 172.21.15.121:0/111870071 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "989b9542-ea3d-4c5c-8f96-23ff25b76fb1", "app": "rados"} v 0) -- 0x7fc40c09f2b0 con 0x7fc40c09c6a0 2024-09-16T07:49:54.513 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:54.514+0000 7fc3f3fff640 1 -- 172.21.15.121:0/111870071 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "989b9542-ea3d-4c5c-8f96-23ff25b76fb1", "app": "rados"}]=0 enabled application 'rados' on pool '989b9542-ea3d-4c5c-8f96-23ff25b76fb1' v696) ==== 213+0+0 (crc 0 0 0) 0x7fc3fc0090b0 con 0x7fc40c09c6a0 2024-09-16T07:49:54.644 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:54.645+0000 7fc41207f640 1 -- 172.21.15.121:0/111870071 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "989b9542-ea3d-4c5c-8f96-23ff25b76fb1", "app": "rados"} v 0) -- 0x7fc40c074650 con 0x7fc40c09c6a0 2024-09-16T07:49:55.521 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.522+0000 7fc3f3fff640 1 -- 172.21.15.121:0/111870071 <== mon.0 v2:172.21.15.121:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "989b9542-ea3d-4c5c-8f96-23ff25b76fb1", "app": "rados"}]=0 enabled application 'rados' on pool '989b9542-ea3d-4c5c-8f96-23ff25b76fb1' v697) ==== 213+0+0 (crc 0 0 0) 0x7fc3fc009290 con 0x7fc40c09c6a0 2024-09-16T07:49:55.521 INFO:tasks.workunit.client.0.smithi121.stderr:enabled application 'rados' on pool '989b9542-ea3d-4c5c-8f96-23ff25b76fb1' 2024-09-16T07:49:55.524 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.525+0000 7fc41207f640 1 -- 172.21.15.121:0/111870071 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fc3f803e930 msgr2=0x7fc3f8040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:49:55.524 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.525+0000 7fc41207f640 1 --2- 172.21.15.121:0/111870071 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fc3f803e930 0x7fc3f8040e40 crc :-1 s=READY pgs=3807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:55.524 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.525+0000 7fc41207f640 1 -- 172.21.15.121:0/111870071 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc40c09c6a0 msgr2=0x7fc40c12eb50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:49:55.524 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.525+0000 7fc41207f640 1 --2- 172.21.15.121:0/111870071 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc40c09c6a0 0x7fc40c12eb50 crc :-1 s=READY pgs=12858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:55.524 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.525+0000 7fc41207f640 1 -- 172.21.15.121:0/111870071 shutdown_connections 2024-09-16T07:49:55.525 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.525+0000 7fc41207f640 1 --2- 172.21.15.121:0/111870071 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fc3f803e930 0x7fc3f8040e40 unknown :-1 s=CLOSED pgs=3807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:55.525 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.525+0000 7fc41207f640 1 --2- 172.21.15.121:0/111870071 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc40c09c6a0 0x7fc40c12eb50 unknown :-1 s=CLOSED pgs=12858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:55.525 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.525+0000 7fc41207f640 1 -- 172.21.15.121:0/111870071 >> 172.21.15.121:0/111870071 conn(0x7fc40c0a30a0 msgr2=0x7fc40c0730f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:49:55.525 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.525+0000 7fc41207f640 1 -- 172.21.15.121:0/111870071 shutdown_connections 2024-09-16T07:49:55.525 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.525+0000 7fc41207f640 1 -- 172.21.15.121:0/111870071 wait complete. 2024-09-16T07:49:55.545 INFO:tasks.workunit.client.0.smithi121.stderr:++ seq 1 10 2024-09-16T07:49:55.628 INFO:tasks.workunit.client.0.smithi121.stderr:+ for f in `seq 1 10` 2024-09-16T07:49:55.628 INFO:tasks.workunit.client.0.smithi121.stderr:+ rados -p 989b9542-ea3d-4c5c-8f96-23ff25b76fb1 put obj1 /etc/passwd 2024-09-16T07:49:55.667 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.668+0000 7f346e50bec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:55.672 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.673+0000 7f346e50bec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:55.672 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.674+0000 7f346e50bec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:55.673 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.674+0000 7f346e50bec0 1 Processor -- start 2024-09-16T07:49:55.673 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.674+0000 7f346e50bec0 1 -- start start 2024-09-16T07:49:55.675 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.675+0000 7f346e50bec0 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xbb9fc0 0xcdcc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:49:55.675 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.675+0000 7f346e50bec0 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0xb26520 con 0xbb9fc0 2024-09-16T07:49:55.675 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.675+0000 7f3466e3f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xbb9fc0 0xcdcc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:49:55.675 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.675+0000 7f3466e3f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xbb9fc0 0xcdcc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44190/0 (socket says 172.21.15.121:44190) 2024-09-16T07:49:55.675 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.675+0000 7f3466e3f640 1 -- 172.21.15.121:0/2938989459 learned_addr learned my addr 172.21.15.121:0/2938989459 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:49:55.675 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.676+0000 7f3466e3f640 1 -- 172.21.15.121:0/2938989459 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xac2e10 con 0xbb9fc0 2024-09-16T07:49:55.675 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.676+0000 7f3466e3f640 1 --2- 172.21.15.121:0/2938989459 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xbb9fc0 0xcdcc40 crc :-1 s=READY pgs=12861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaabdc6547782073 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:49:55.675 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.676+0000 7f346563c640 1 -- 172.21.15.121:0/2938989459 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f345002dc90 con 0xbb9fc0 2024-09-16T07:49:55.676 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.676+0000 7f346563c640 1 -- 172.21.15.121:0/2938989459 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f345000a040 con 0xbb9fc0 2024-09-16T07:49:55.676 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.676+0000 7f346563c640 1 -- 172.21.15.121:0/2938989459 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f345000a2e0 con 0xbb9fc0 2024-09-16T07:49:55.677 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.677+0000 7f346e50bec0 1 -- 172.21.15.121:0/2938989459 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xbb9fc0 msgr2=0xcdcc40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:49:55.677 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.677+0000 7f346e50bec0 1 --2- 172.21.15.121:0/2938989459 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xbb9fc0 0xcdcc40 crc :-1 s=READY pgs=12861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:55.677 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.677+0000 7f346e50bec0 1 -- 172.21.15.121:0/2938989459 shutdown_connections 2024-09-16T07:49:55.677 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.677+0000 7f346e50bec0 1 --2- 172.21.15.121:0/2938989459 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xbb9fc0 0xcdcc40 unknown :-1 s=CLOSED pgs=12861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:55.677 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.677+0000 7f346e50bec0 1 -- 172.21.15.121:0/2938989459 >> 172.21.15.121:0/2938989459 conn(0xae6770 msgr2=0xbc59b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:49:55.677 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.677+0000 7f346e50bec0 1 -- 172.21.15.121:0/2938989459 shutdown_connections 2024-09-16T07:49:55.677 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.677+0000 7f346e50bec0 1 -- 172.21.15.121:0/2938989459 wait complete. 2024-09-16T07:49:55.677 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.678+0000 7f346e50bec0 1 Processor -- start 2024-09-16T07:49:55.677 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.678+0000 7f346e50bec0 1 -- start start 2024-09-16T07:49:55.679 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.679+0000 7f346e50bec0 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xbb9fc0 0xcc2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:49:55.679 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.679+0000 7f346e50bec0 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0xb24280 con 0xbb9fc0 2024-09-16T07:49:55.679 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.679+0000 7f3466e3f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xbb9fc0 0xcc2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:49:55.679 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.679+0000 7f3466e3f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xbb9fc0 0xcc2b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44200/0 (socket says 172.21.15.121:44200) 2024-09-16T07:49:55.679 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.679+0000 7f3466e3f640 1 -- 172.21.15.121:0/1272980807 learned_addr learned my addr 172.21.15.121:0/1272980807 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:49:55.679 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.679+0000 7f3466e3f640 1 -- 172.21.15.121:0/1272980807 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xab4920 con 0xbb9fc0 2024-09-16T07:49:55.679 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.679+0000 7f3466e3f640 1 --2- 172.21.15.121:0/1272980807 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xbb9fc0 0xcc2b20 crc :-1 s=READY pgs=12862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:49:55.680 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.679+0000 7f345f7fe640 1 -- 172.21.15.121:0/1272980807 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f345002dc90 con 0xbb9fc0 2024-09-16T07:49:55.680 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.679+0000 7f345f7fe640 1 -- 172.21.15.121:0/1272980807 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f345002de90 con 0xbb9fc0 2024-09-16T07:49:55.680 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.679+0000 7f345f7fe640 1 -- 172.21.15.121:0/1272980807 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f345000a2e0 con 0xbb9fc0 2024-09-16T07:49:55.680 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.679+0000 7f346e50bec0 1 -- 172.21.15.121:0/1272980807 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0xab4380 con 0xbb9fc0 2024-09-16T07:49:55.680 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.679+0000 7f346e50bec0 1 -- 172.21.15.121:0/1272980807 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0xcc2760 con 0xbb9fc0 2024-09-16T07:49:55.682 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.680+0000 7f345f7fe640 1 -- 172.21.15.121:0/1272980807 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f3450009c70 con 0xbb9fc0 2024-09-16T07:49:55.682 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.681+0000 7f345f7fe640 1 --2- 172.21.15.121:0/1272980807 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f344c03d1c0 0x7f344c03f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:49:55.682 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.681+0000 7f345f7fe640 1 -- 172.21.15.121:0/1272980807 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(697..697 src has 620..697) ==== 3819+0+0 (crc 0 0 0) 0x7f3450032040 con 0xbb9fc0 2024-09-16T07:49:55.682 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.681+0000 7f346e50bec0 1 --2- 172.21.15.121:0/1272980807 >> v2:172.21.15.121:6808/3193900849 conn(0xbc2130 0xce7750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:49:55.682 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.681+0000 7f346e50bec0 1 -- 172.21.15.121:0/1272980807 --> v2:172.21.15.121:6808/3193900849 -- osd_op(unknown.0.0:1 199.7 199:ff7b1f36:::obj1:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e697) -- 0xcc40a0 con 0xbc2130 2024-09-16T07:49:55.682 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.681+0000 7f346663e640 1 --2- 172.21.15.121:0/1272980807 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f344c03d1c0 0x7f344c03f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:49:55.682 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.681+0000 7f346663e640 1 --2- 172.21.15.121:0/1272980807 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f344c03d1c0 0x7f344c03f6d0 crc :-1 s=READY pgs=3808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:49:55.683 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.682+0000 7f3467640640 1 --2- 172.21.15.121:0/1272980807 >> v2:172.21.15.121:6808/3193900849 conn(0xbc2130 0xce7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T07:49:55.685 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.686+0000 7f3467640640 1 --2- 172.21.15.121:0/1272980807 >> v2:172.21.15.121:6808/3193900849 conn(0xbc2130 0xce7750 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:49:55.699 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.700+0000 7f3467640640 1 -- 172.21.15.121:0/1272980807 <== osd.0 v2:172.21.15.121:6808/3193900849 1 ==== osd_op_reply(1 obj1 [writefull 0~12875] v697'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f345800a430 con 0xbc2130 2024-09-16T07:49:55.700 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.700+0000 7f346e50bec0 1 -- 172.21.15.121:0/1272980807 >> v2:172.21.15.121:6808/3193900849 conn(0xbc2130 msgr2=0xce7750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:49:55.700 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.700+0000 7f346e50bec0 1 --2- 172.21.15.121:0/1272980807 >> v2:172.21.15.121:6808/3193900849 conn(0xbc2130 0xce7750 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:55.700 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.700+0000 7f346e50bec0 1 -- 172.21.15.121:0/1272980807 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f344c03d1c0 msgr2=0x7f344c03f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:49:55.700 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.700+0000 7f346e50bec0 1 --2- 172.21.15.121:0/1272980807 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f344c03d1c0 0x7f344c03f6d0 crc :-1 s=READY pgs=3808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:55.700 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.700+0000 7f346e50bec0 1 -- 172.21.15.121:0/1272980807 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xbb9fc0 msgr2=0xcc2b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:49:55.700 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.700+0000 7f346e50bec0 1 --2- 172.21.15.121:0/1272980807 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xbb9fc0 0xcc2b20 crc :-1 s=READY pgs=12862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:55.700 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.700+0000 7f346e50bec0 1 -- 172.21.15.121:0/1272980807 shutdown_connections 2024-09-16T07:49:55.700 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.700+0000 7f346e50bec0 1 --2- 172.21.15.121:0/1272980807 >> v2:172.21.15.121:6808/3193900849 conn(0xbc2130 0xce7750 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:55.700 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.700+0000 7f346e50bec0 1 --2- 172.21.15.121:0/1272980807 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f344c03d1c0 0x7f344c03f6d0 unknown :-1 s=CLOSED pgs=3808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:55.700 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.700+0000 7f346e50bec0 1 --2- 172.21.15.121:0/1272980807 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xbb9fc0 0xcc2b20 unknown :-1 s=CLOSED pgs=12862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:55.700 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.700+0000 7f346e50bec0 1 -- 172.21.15.121:0/1272980807 >> 172.21.15.121:0/1272980807 conn(0xae6770 msgr2=0xbc4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:49:55.701 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.700+0000 7f346e50bec0 1 -- 172.21.15.121:0/1272980807 shutdown_connections 2024-09-16T07:49:55.701 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.700+0000 7f346e50bec0 1 -- 172.21.15.121:0/1272980807 wait complete. 2024-09-16T07:49:55.702 INFO:tasks.workunit.client.0.smithi121.stderr:+ for f in `seq 1 10` 2024-09-16T07:49:55.702 INFO:tasks.workunit.client.0.smithi121.stderr:+ rados -p 989b9542-ea3d-4c5c-8f96-23ff25b76fb1 put obj2 /etc/passwd 2024-09-16T07:49:55.738 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.739+0000 7f90a391cec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:55.743 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.744+0000 7f90a391cec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:55.743 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.744+0000 7f90a391cec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:55.744 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.745+0000 7f90a391cec0 1 Processor -- start 2024-09-16T07:49:55.744 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.745+0000 7f90a391cec0 1 -- start start 2024-09-16T07:49:55.745 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.746+0000 7f90a391cec0 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x14bb300 0x14b6c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:49:55.746 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.746+0000 7f90a391cec0 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x141f520 con 0x14bb300 2024-09-16T07:49:55.746 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.746+0000 7f90977fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x14bb300 0x14b6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:49:55.746 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.746+0000 7f90977fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x14bb300 0x14b6c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44224/0 (socket says 172.21.15.121:44224) 2024-09-16T07:49:55.746 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.746+0000 7f90977fe640 1 -- 172.21.15.121:0/1474000545 learned_addr learned my addr 172.21.15.121:0/1474000545 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:49:55.746 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.747+0000 7f90977fe640 1 -- 172.21.15.121:0/1474000545 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x13bbe10 con 0x14bb300 2024-09-16T07:49:55.746 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.747+0000 7f90977fe640 1 --2- 172.21.15.121:0/1474000545 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x14bb300 0x14b6c40 crc :-1 s=READY pgs=12865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=155632d7c6ef91fa server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:49:55.746 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.747+0000 7f9095ffb640 1 -- 172.21.15.121:0/1474000545 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f908402f780 con 0x14bb300 2024-09-16T07:49:55.746 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.747+0000 7f9095ffb640 1 -- 172.21.15.121:0/1474000545 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f908400a380 con 0x14bb300 2024-09-16T07:49:55.746 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.747+0000 7f9095ffb640 1 -- 172.21.15.121:0/1474000545 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f908402fab0 con 0x14bb300 2024-09-16T07:49:55.747 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.747+0000 7f90a391cec0 1 -- 172.21.15.121:0/1474000545 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x14bb300 msgr2=0x14b6c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:49:55.747 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.747+0000 7f90a391cec0 1 --2- 172.21.15.121:0/1474000545 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x14bb300 0x14b6c40 crc :-1 s=READY pgs=12865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:55.748 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.747+0000 7f90a391cec0 1 -- 172.21.15.121:0/1474000545 shutdown_connections 2024-09-16T07:49:55.748 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.747+0000 7f90a391cec0 1 --2- 172.21.15.121:0/1474000545 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x14bb300 0x14b6c40 unknown :-1 s=CLOSED pgs=12865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:55.748 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.747+0000 7f90a391cec0 1 -- 172.21.15.121:0/1474000545 >> 172.21.15.121:0/1474000545 conn(0x13df770 msgr2=0x14b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:49:55.748 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.747+0000 7f90a391cec0 1 -- 172.21.15.121:0/1474000545 shutdown_connections 2024-09-16T07:49:55.748 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.748+0000 7f90a391cec0 1 -- 172.21.15.121:0/1474000545 wait complete. 2024-09-16T07:49:55.748 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.748+0000 7f90a391cec0 1 Processor -- start 2024-09-16T07:49:55.748 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.748+0000 7f90a391cec0 1 -- start start 2024-09-16T07:49:55.749 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.749+0000 7f90a391cec0 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x14bb300 0x15d8820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:49:55.750 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.749+0000 7f90a391cec0 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x141d280 con 0x14bb300 2024-09-16T07:49:55.750 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.749+0000 7f90977fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x14bb300 0x15d8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:49:55.750 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.749+0000 7f90977fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x14bb300 0x15d8820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44236/0 (socket says 172.21.15.121:44236) 2024-09-16T07:49:55.750 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.749+0000 7f90977fe640 1 -- 172.21.15.121:0/877721739 learned_addr learned my addr 172.21.15.121:0/877721739 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:49:55.750 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.750+0000 7f90977fe640 1 -- 172.21.15.121:0/877721739 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x13ad920 con 0x14bb300 2024-09-16T07:49:55.750 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.750+0000 7f90977fe640 1 --2- 172.21.15.121:0/877721739 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x14bb300 0x15d8820 crc :-1 s=READY pgs=12866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:49:55.750 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.750+0000 7f9094ff9640 1 -- 172.21.15.121:0/877721739 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f90840057c0 con 0x14bb300 2024-09-16T07:49:55.750 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.750+0000 7f9094ff9640 1 -- 172.21.15.121:0/877721739 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f908402f780 con 0x14bb300 2024-09-16T07:49:55.750 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.750+0000 7f90a391cec0 1 -- 172.21.15.121:0/877721739 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x13ad380 con 0x14bb300 2024-09-16T07:49:55.750 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.750+0000 7f9094ff9640 1 -- 172.21.15.121:0/877721739 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f908402f980 con 0x14bb300 2024-09-16T07:49:55.750 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.750+0000 7f90a391cec0 1 -- 172.21.15.121:0/877721739 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x15d4890 con 0x14bb300 2024-09-16T07:49:55.752 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.751+0000 7f9094ff9640 1 -- 172.21.15.121:0/877721739 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f9084037040 con 0x14bb300 2024-09-16T07:49:55.752 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.751+0000 7f9094ff9640 1 --2- 172.21.15.121:0/877721739 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f908003d1c0 0x7f908003f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:49:55.752 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.751+0000 7f9094ff9640 1 -- 172.21.15.121:0/877721739 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(697..697 src has 620..697) ==== 3819+0+0 (crc 0 0 0) 0x7f9084040040 con 0x14bb300 2024-09-16T07:49:55.752 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.752+0000 7f90a391cec0 1 --2- 172.21.15.121:0/877721739 >> v2:172.21.15.172:6808/3418488586 conn(0x14bbc50 0x15e04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:49:55.752 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.752+0000 7f90a391cec0 1 -- 172.21.15.121:0/877721739 --> v2:172.21.15.172:6808/3418488586 -- osd_op(unknown.0.0:1 199.8 199:104778fc:::obj2:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e697) -- 0x15d78f0 con 0x14bbc50 2024-09-16T07:49:55.752 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.752+0000 7f9096ffd640 1 --2- 172.21.15.121:0/877721739 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f908003d1c0 0x7f908003f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:49:55.752 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.752+0000 7f9096ffd640 1 --2- 172.21.15.121:0/877721739 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f908003d1c0 0x7f908003f6d0 crc :-1 s=READY pgs=3809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:49:55.752 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.753+0000 7f9097fff640 1 --2- 172.21.15.121:0/877721739 >> v2:172.21.15.172:6808/3418488586 conn(0x14bbc50 0x15e04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T07:49:55.756 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.757+0000 7f9097fff640 1 --2- 172.21.15.121:0/877721739 >> v2:172.21.15.172:6808/3418488586 conn(0x14bbc50 0x15e04d0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:49:55.772 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.772+0000 7f9097fff640 1 -- 172.21.15.121:0/877721739 <== osd.3 v2:172.21.15.172:6808/3418488586 1 ==== osd_op_reply(1 obj2 [writefull 0~12875] v697'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f908c00a430 con 0x14bbc50 2024-09-16T07:49:55.772 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.772+0000 7f90a391cec0 1 -- 172.21.15.121:0/877721739 >> v2:172.21.15.172:6808/3418488586 conn(0x14bbc50 msgr2=0x15e04d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:49:55.772 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.772+0000 7f90a391cec0 1 --2- 172.21.15.121:0/877721739 >> v2:172.21.15.172:6808/3418488586 conn(0x14bbc50 0x15e04d0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:55.772 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.772+0000 7f90a391cec0 1 -- 172.21.15.121:0/877721739 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f908003d1c0 msgr2=0x7f908003f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:49:55.773 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.772+0000 7f90a391cec0 1 --2- 172.21.15.121:0/877721739 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f908003d1c0 0x7f908003f6d0 crc :-1 s=READY pgs=3809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:55.773 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.772+0000 7f90a391cec0 1 -- 172.21.15.121:0/877721739 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x14bb300 msgr2=0x15d8820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:49:55.773 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.772+0000 7f90a391cec0 1 --2- 172.21.15.121:0/877721739 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x14bb300 0x15d8820 crc :-1 s=READY pgs=12866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:55.773 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.773+0000 7f90a391cec0 1 -- 172.21.15.121:0/877721739 shutdown_connections 2024-09-16T07:49:55.773 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.773+0000 7f90a391cec0 1 --2- 172.21.15.121:0/877721739 >> v2:172.21.15.172:6808/3418488586 conn(0x14bbc50 0x15e04d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:55.773 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.773+0000 7f90a391cec0 1 --2- 172.21.15.121:0/877721739 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f908003d1c0 0x7f908003f6d0 unknown :-1 s=CLOSED pgs=3809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:55.774 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.773+0000 7f90a391cec0 1 --2- 172.21.15.121:0/877721739 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x14bb300 0x15d8820 unknown :-1 s=CLOSED pgs=12866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:55.774 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.773+0000 7f90a391cec0 1 -- 172.21.15.121:0/877721739 >> 172.21.15.121:0/877721739 conn(0x13df770 msgr2=0x14b8280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:49:55.774 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.773+0000 7f90a391cec0 1 -- 172.21.15.121:0/877721739 shutdown_connections 2024-09-16T07:49:55.774 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.773+0000 7f90a391cec0 1 -- 172.21.15.121:0/877721739 wait complete. 2024-09-16T07:49:55.776 INFO:tasks.workunit.client.0.smithi121.stderr:+ for f in `seq 1 10` 2024-09-16T07:49:55.777 INFO:tasks.workunit.client.0.smithi121.stderr:+ rados -p 989b9542-ea3d-4c5c-8f96-23ff25b76fb1 put obj3 /etc/passwd 2024-09-16T07:49:55.810 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.811+0000 7f3ff3e34ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:55.815 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.816+0000 7f3ff3e34ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:55.815 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.816+0000 7f3ff3e34ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:55.816 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.817+0000 7f3ff3e34ec0 1 Processor -- start 2024-09-16T07:49:55.816 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.817+0000 7f3ff3e34ec0 1 -- start start 2024-09-16T07:49:55.819 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.818+0000 7f3ff3e34ec0 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x1873fc0 0x18808e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:49:55.819 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.818+0000 7f3ff3e34ec0 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x17e0520 con 0x1873fc0 2024-09-16T07:49:55.820 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.818+0000 7f3fe77fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x1873fc0 0x18808e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:49:55.820 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.818+0000 7f3fe77fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x1873fc0 0x18808e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44266/0 (socket says 172.21.15.121:44266) 2024-09-16T07:49:55.820 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.818+0000 7f3fe77fe640 1 -- 172.21.15.121:0/4060814787 learned_addr learned my addr 172.21.15.121:0/4060814787 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:49:55.820 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.818+0000 7f3fe77fe640 1 -- 172.21.15.121:0/4060814787 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x177ce10 con 0x1873fc0 2024-09-16T07:49:55.820 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.818+0000 7f3fe77fe640 1 --2- 172.21.15.121:0/4060814787 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x1873fc0 0x18808e0 crc :-1 s=READY pgs=12869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f552118368b32849 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:49:55.820 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.818+0000 7f3fe5ffb640 1 -- 172.21.15.121:0/4060814787 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3fd402dcc0 con 0x1873fc0 2024-09-16T07:49:55.821 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.818+0000 7f3fe5ffb640 1 -- 172.21.15.121:0/4060814787 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f3fd4037370 con 0x1873fc0 2024-09-16T07:49:55.821 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.818+0000 7f3fe5ffb640 1 -- 172.21.15.121:0/4060814787 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3fd4037610 con 0x1873fc0 2024-09-16T07:49:55.821 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.819+0000 7f3ff3e34ec0 1 -- 172.21.15.121:0/4060814787 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x1873fc0 msgr2=0x18808e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:49:55.821 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.819+0000 7f3ff3e34ec0 1 --2- 172.21.15.121:0/4060814787 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x1873fc0 0x18808e0 crc :-1 s=READY pgs=12869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:55.821 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.819+0000 7f3ff3e34ec0 1 -- 172.21.15.121:0/4060814787 shutdown_connections 2024-09-16T07:49:55.821 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.819+0000 7f3ff3e34ec0 1 --2- 172.21.15.121:0/4060814787 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x1873fc0 0x18808e0 unknown :-1 s=CLOSED pgs=12869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:55.822 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.819+0000 7f3ff3e34ec0 1 -- 172.21.15.121:0/4060814787 >> 172.21.15.121:0/4060814787 conn(0x17a0770 msgr2=0x1875700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:49:55.822 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.819+0000 7f3ff3e34ec0 1 -- 172.21.15.121:0/4060814787 shutdown_connections 2024-09-16T07:49:55.822 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.819+0000 7f3ff3e34ec0 1 -- 172.21.15.121:0/4060814787 wait complete. 2024-09-16T07:49:55.822 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.820+0000 7f3ff3e34ec0 1 Processor -- start 2024-09-16T07:49:55.822 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.820+0000 7f3ff3e34ec0 1 -- start start 2024-09-16T07:49:55.825 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.821+0000 7f3ff3e34ec0 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x1873fc0 0x1982fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:49:55.825 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.821+0000 7f3ff3e34ec0 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x17de280 con 0x1873fc0 2024-09-16T07:49:55.825 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.821+0000 7f3fe77fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x1873fc0 0x1982fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:49:55.825 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.821+0000 7f3fe77fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x1873fc0 0x1982fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44280/0 (socket says 172.21.15.121:44280) 2024-09-16T07:49:55.825 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.821+0000 7f3fe77fe640 1 -- 172.21.15.121:0/4258687114 learned_addr learned my addr 172.21.15.121:0/4258687114 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:49:55.825 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.821+0000 7f3fe77fe640 1 -- 172.21.15.121:0/4258687114 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x176e920 con 0x1873fc0 2024-09-16T07:49:55.825 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.821+0000 7f3fe77fe640 1 --2- 172.21.15.121:0/4258687114 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x1873fc0 0x1982fd0 crc :-1 s=READY pgs=12870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:49:55.825 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.821+0000 7f3fe4ff9640 1 -- 172.21.15.121:0/4258687114 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3fd4037610 con 0x1873fc0 2024-09-16T07:49:55.826 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.821+0000 7f3fe4ff9640 1 -- 172.21.15.121:0/4258687114 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f3fd402db90 con 0x1873fc0 2024-09-16T07:49:55.826 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.821+0000 7f3ff3e34ec0 1 -- 172.21.15.121:0/4258687114 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x176e380 con 0x1873fc0 2024-09-16T07:49:55.826 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.821+0000 7f3fe4ff9640 1 -- 172.21.15.121:0/4258687114 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3fd4039580 con 0x1873fc0 2024-09-16T07:49:55.826 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.822+0000 7f3ff3e34ec0 1 -- 172.21.15.121:0/4258687114 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1985060 con 0x1873fc0 2024-09-16T07:49:55.826 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.822+0000 7f3fe4ff9640 1 -- 172.21.15.121:0/4258687114 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f3fd4039730 con 0x1873fc0 2024-09-16T07:49:55.826 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.823+0000 7f3fe4ff9640 1 --2- 172.21.15.121:0/4258687114 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f3fd003d1c0 0x7f3fd003f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:49:55.826 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.823+0000 7f3fe4ff9640 1 -- 172.21.15.121:0/4258687114 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(697..697 src has 620..697) ==== 3819+0+0 (crc 0 0 0) 0x7f3fd4032040 con 0x1873fc0 2024-09-16T07:49:55.826 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.823+0000 7f3ff3e34ec0 1 --2- 172.21.15.121:0/4258687114 >> v2:172.21.15.121:6808/3193900849 conn(0x187c130 0x1995360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:49:55.826 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.823+0000 7f3ff3e34ec0 1 -- 172.21.15.121:0/4258687114 --> v2:172.21.15.121:6808/3193900849 -- osd_op(unknown.0.0:1 199.1 199:8dd16f86:::obj3:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e697) -- 0x1986850 con 0x187c130 2024-09-16T07:49:55.826 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.823+0000 7f3fe6ffd640 1 --2- 172.21.15.121:0/4258687114 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f3fd003d1c0 0x7f3fd003f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:49:55.826 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.824+0000 7f3fe7fff640 1 --2- 172.21.15.121:0/4258687114 >> v2:172.21.15.121:6808/3193900849 conn(0x187c130 0x1995360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T07:49:55.826 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.824+0000 7f3fe6ffd640 1 --2- 172.21.15.121:0/4258687114 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f3fd003d1c0 0x7f3fd003f6d0 crc :-1 s=READY pgs=3810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:49:55.826 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.826+0000 7f3fe7fff640 1 --2- 172.21.15.121:0/4258687114 >> v2:172.21.15.121:6808/3193900849 conn(0x187c130 0x1995360 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:49:55.839 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.839+0000 7f3fe7fff640 1 -- 172.21.15.121:0/4258687114 <== osd.0 v2:172.21.15.121:6808/3193900849 1 ==== osd_op_reply(1 obj3 [writefull 0~12875] v697'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3fdc00a430 con 0x187c130 2024-09-16T07:49:55.839 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.839+0000 7f3ff3e34ec0 1 -- 172.21.15.121:0/4258687114 >> v2:172.21.15.121:6808/3193900849 conn(0x187c130 msgr2=0x1995360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:49:55.839 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.839+0000 7f3ff3e34ec0 1 --2- 172.21.15.121:0/4258687114 >> v2:172.21.15.121:6808/3193900849 conn(0x187c130 0x1995360 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:55.839 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.839+0000 7f3ff3e34ec0 1 -- 172.21.15.121:0/4258687114 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f3fd003d1c0 msgr2=0x7f3fd003f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:49:55.839 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.839+0000 7f3ff3e34ec0 1 --2- 172.21.15.121:0/4258687114 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f3fd003d1c0 0x7f3fd003f6d0 crc :-1 s=READY pgs=3810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:55.839 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.839+0000 7f3ff3e34ec0 1 -- 172.21.15.121:0/4258687114 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x1873fc0 msgr2=0x1982fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:49:55.839 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.839+0000 7f3ff3e34ec0 1 --2- 172.21.15.121:0/4258687114 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x1873fc0 0x1982fd0 crc :-1 s=READY pgs=12870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:55.839 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.839+0000 7f3ff3e34ec0 1 -- 172.21.15.121:0/4258687114 shutdown_connections 2024-09-16T07:49:55.839 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.839+0000 7f3ff3e34ec0 1 --2- 172.21.15.121:0/4258687114 >> v2:172.21.15.121:6808/3193900849 conn(0x187c130 0x1995360 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:55.839 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.839+0000 7f3ff3e34ec0 1 --2- 172.21.15.121:0/4258687114 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f3fd003d1c0 0x7f3fd003f6d0 unknown :-1 s=CLOSED pgs=3810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:55.840 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.839+0000 7f3ff3e34ec0 1 --2- 172.21.15.121:0/4258687114 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x1873fc0 0x1982fd0 unknown :-1 s=CLOSED pgs=12870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:55.840 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.839+0000 7f3ff3e34ec0 1 -- 172.21.15.121:0/4258687114 >> 172.21.15.121:0/4258687114 conn(0x17a0770 msgr2=0x1875700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:49:55.840 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.839+0000 7f3ff3e34ec0 1 -- 172.21.15.121:0/4258687114 shutdown_connections 2024-09-16T07:49:55.840 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.839+0000 7f3ff3e34ec0 1 -- 172.21.15.121:0/4258687114 wait complete. 2024-09-16T07:49:55.841 INFO:tasks.workunit.client.0.smithi121.stderr:+ for f in `seq 1 10` 2024-09-16T07:49:55.841 INFO:tasks.workunit.client.0.smithi121.stderr:+ rados -p 989b9542-ea3d-4c5c-8f96-23ff25b76fb1 put obj4 /etc/passwd 2024-09-16T07:49:55.878 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.878+0000 7f21c1924ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:55.882 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.883+0000 7f21c1924ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:55.882 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.884+0000 7f21c1924ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:55.883 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.884+0000 7f21c1924ec0 1 Processor -- start 2024-09-16T07:49:55.883 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.884+0000 7f21c1924ec0 1 -- start start 2024-09-16T07:49:55.885 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.885+0000 7f21c1924ec0 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x1b4b9b0 0x1bd38f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:49:55.885 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.885+0000 7f21c1924ec0 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x1a1d520 con 0x1b4b9b0 2024-09-16T07:49:55.885 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.885+0000 7f21b9c3f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x1b4b9b0 0x1bd38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:49:55.885 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.885+0000 7f21b9c3f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x1b4b9b0 0x1bd38f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44294/0 (socket says 172.21.15.121:44294) 2024-09-16T07:49:55.885 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.885+0000 7f21b9c3f640 1 -- 172.21.15.121:0/1196675953 learned_addr learned my addr 172.21.15.121:0/1196675953 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:49:55.885 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.886+0000 7f21b9c3f640 1 -- 172.21.15.121:0/1196675953 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x19b9e10 con 0x1b4b9b0 2024-09-16T07:49:55.885 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.886+0000 7f21b9c3f640 1 --2- 172.21.15.121:0/1196675953 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x1b4b9b0 0x1bd38f0 crc :-1 s=READY pgs=12873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8d4aadd20ec3bd8 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:49:55.885 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.886+0000 7f21b3fff640 1 -- 172.21.15.121:0/1196675953 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f21a400c490 con 0x1b4b9b0 2024-09-16T07:49:55.885 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.886+0000 7f21b3fff640 1 -- 172.21.15.121:0/1196675953 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f21a400c5f0 con 0x1b4b9b0 2024-09-16T07:49:55.885 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.886+0000 7f21b3fff640 1 -- 172.21.15.121:0/1196675953 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f21a400c890 con 0x1b4b9b0 2024-09-16T07:49:55.886 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.886+0000 7f21c1924ec0 1 -- 172.21.15.121:0/1196675953 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x1b4b9b0 msgr2=0x1bd38f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:49:55.886 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.886+0000 7f21c1924ec0 1 --2- 172.21.15.121:0/1196675953 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x1b4b9b0 0x1bd38f0 crc :-1 s=READY pgs=12873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:55.887 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.886+0000 7f21c1924ec0 1 -- 172.21.15.121:0/1196675953 shutdown_connections 2024-09-16T07:49:55.887 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.886+0000 7f21c1924ec0 1 --2- 172.21.15.121:0/1196675953 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x1b4b9b0 0x1bd38f0 unknown :-1 s=CLOSED pgs=12873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:55.887 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.886+0000 7f21c1924ec0 1 -- 172.21.15.121:0/1196675953 >> 172.21.15.121:0/1196675953 conn(0x19dd770 msgr2=0x1ab62b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:49:55.887 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.886+0000 7f21c1924ec0 1 -- 172.21.15.121:0/1196675953 shutdown_connections 2024-09-16T07:49:55.887 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.887+0000 7f21c1924ec0 1 -- 172.21.15.121:0/1196675953 wait complete. 2024-09-16T07:49:55.887 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.887+0000 7f21c1924ec0 1 Processor -- start 2024-09-16T07:49:55.887 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.887+0000 7f21c1924ec0 1 -- start start 2024-09-16T07:49:55.889 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.888+0000 7f21c1924ec0 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x1b4b9b0 0x1be0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:49:55.889 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.888+0000 7f21c1924ec0 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x1a1b280 con 0x1b4b9b0 2024-09-16T07:49:55.889 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.888+0000 7f21b9c3f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x1b4b9b0 0x1be0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:49:55.889 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.888+0000 7f21b9c3f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x1b4b9b0 0x1be0810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44310/0 (socket says 172.21.15.121:44310) 2024-09-16T07:49:55.889 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.888+0000 7f21b9c3f640 1 -- 172.21.15.121:0/493303799 learned_addr learned my addr 172.21.15.121:0/493303799 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:49:55.889 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.889+0000 7f21b9c3f640 1 -- 172.21.15.121:0/493303799 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x19ab920 con 0x1b4b9b0 2024-09-16T07:49:55.889 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.889+0000 7f21b9c3f640 1 --2- 172.21.15.121:0/493303799 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x1b4b9b0 0x1be0810 crc :-1 s=READY pgs=12874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:49:55.889 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.889+0000 7f21b2ffd640 1 -- 172.21.15.121:0/493303799 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f21a40110b0 con 0x1b4b9b0 2024-09-16T07:49:55.890 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.889+0000 7f21b2ffd640 1 -- 172.21.15.121:0/493303799 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f21a4011210 con 0x1b4b9b0 2024-09-16T07:49:55.890 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.889+0000 7f21c1924ec0 1 -- 172.21.15.121:0/493303799 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x19ab380 con 0x1b4b9b0 2024-09-16T07:49:55.890 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.889+0000 7f21b2ffd640 1 -- 172.21.15.121:0/493303799 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f21a4011b30 con 0x1b4b9b0 2024-09-16T07:49:55.890 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.889+0000 7f21c1924ec0 1 -- 172.21.15.121:0/493303799 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1b4b800 con 0x1b4b9b0 2024-09-16T07:49:55.890 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.890+0000 7f21b2ffd640 1 -- 172.21.15.121:0/493303799 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f21a4011ce0 con 0x1b4b9b0 2024-09-16T07:49:55.891 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.890+0000 7f21b2ffd640 1 --2- 172.21.15.121:0/493303799 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f21a003d1c0 0x7f21a003f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:49:55.891 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.891+0000 7f21b2ffd640 1 -- 172.21.15.121:0/493303799 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(697..697 src has 620..697) ==== 3819+0+0 (crc 0 0 0) 0x7f21a40501a0 con 0x1b4b9b0 2024-09-16T07:49:55.891 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.891+0000 7f21c1924ec0 1 --2- 172.21.15.121:0/493303799 >> v2:172.21.15.121:6801/4208564222 conn(0x1b4c4d0 0x1b4a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:49:55.891 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.891+0000 7f21c1924ec0 1 -- 172.21.15.121:0/493303799 --> v2:172.21.15.121:6801/4208564222 -- osd_op(unknown.0.0:1 199.0 199:0ee9ae15:::obj4:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e697) -- 0x1b3aa80 con 0x1b4c4d0 2024-09-16T07:49:55.891 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.891+0000 7f21b943e640 1 --2- 172.21.15.121:0/493303799 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f21a003d1c0 0x7f21a003f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:49:55.891 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.891+0000 7f21b943e640 1 --2- 172.21.15.121:0/493303799 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f21a003d1c0 0x7f21a003f6d0 crc :-1 s=READY pgs=3811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:49:55.891 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.892+0000 7f21ba440640 1 --2- 172.21.15.121:0/493303799 >> v2:172.21.15.121:6801/4208564222 conn(0x1b4c4d0 0x1b4a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T07:49:55.894 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.895+0000 7f21ba440640 1 --2- 172.21.15.121:0/493303799 >> v2:172.21.15.121:6801/4208564222 conn(0x1b4c4d0 0x1b4a510 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:49:55.909 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.909+0000 7f21ba440640 1 -- 172.21.15.121:0/493303799 <== osd.1 v2:172.21.15.121:6801/4208564222 1 ==== osd_op_reply(1 obj4 [writefull 0~12875] v697'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f21ac00a430 con 0x1b4c4d0 2024-09-16T07:49:55.910 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.909+0000 7f21c1924ec0 1 -- 172.21.15.121:0/493303799 >> v2:172.21.15.121:6801/4208564222 conn(0x1b4c4d0 msgr2=0x1b4a510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:49:55.910 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.909+0000 7f21c1924ec0 1 --2- 172.21.15.121:0/493303799 >> v2:172.21.15.121:6801/4208564222 conn(0x1b4c4d0 0x1b4a510 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:55.910 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.909+0000 7f21c1924ec0 1 -- 172.21.15.121:0/493303799 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f21a003d1c0 msgr2=0x7f21a003f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:49:55.910 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.909+0000 7f21c1924ec0 1 --2- 172.21.15.121:0/493303799 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f21a003d1c0 0x7f21a003f6d0 crc :-1 s=READY pgs=3811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:55.910 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.909+0000 7f21c1924ec0 1 -- 172.21.15.121:0/493303799 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x1b4b9b0 msgr2=0x1be0810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:49:55.911 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.909+0000 7f21c1924ec0 1 --2- 172.21.15.121:0/493303799 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x1b4b9b0 0x1be0810 crc :-1 s=READY pgs=12874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:55.911 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.909+0000 7f21c1924ec0 1 -- 172.21.15.121:0/493303799 shutdown_connections 2024-09-16T07:49:55.911 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.909+0000 7f21c1924ec0 1 --2- 172.21.15.121:0/493303799 >> v2:172.21.15.121:6801/4208564222 conn(0x1b4c4d0 0x1b4a510 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:55.911 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.909+0000 7f21c1924ec0 1 --2- 172.21.15.121:0/493303799 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f21a003d1c0 0x7f21a003f6d0 unknown :-1 s=CLOSED pgs=3811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:55.911 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.909+0000 7f21c1924ec0 1 --2- 172.21.15.121:0/493303799 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x1b4b9b0 0x1be0810 unknown :-1 s=CLOSED pgs=12874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:55.911 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.909+0000 7f21c1924ec0 1 -- 172.21.15.121:0/493303799 >> 172.21.15.121:0/493303799 conn(0x19dd770 msgr2=0x1ab62b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:49:55.912 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.909+0000 7f21c1924ec0 1 -- 172.21.15.121:0/493303799 shutdown_connections 2024-09-16T07:49:55.912 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.909+0000 7f21c1924ec0 1 -- 172.21.15.121:0/493303799 wait complete. 2024-09-16T07:49:55.912 INFO:tasks.workunit.client.0.smithi121.stderr:+ for f in `seq 1 10` 2024-09-16T07:49:55.913 INFO:tasks.workunit.client.0.smithi121.stderr:+ rados -p 989b9542-ea3d-4c5c-8f96-23ff25b76fb1 put obj5 /etc/passwd 2024-09-16T07:49:55.947 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.948+0000 7f354f922ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:55.952 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.953+0000 7f354f922ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:55.952 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.953+0000 7f354f922ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:55.953 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.954+0000 7f354f922ec0 1 Processor -- start 2024-09-16T07:49:55.953 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.954+0000 7f354f922ec0 1 -- start start 2024-09-16T07:49:55.954 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.955+0000 7f354f922ec0 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7a6fc0 0x794d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:49:55.954 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.955+0000 7f354f922ec0 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x713520 con 0x7a6fc0 2024-09-16T07:49:55.954 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.955+0000 7f35437fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7a6fc0 0x794d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:49:55.955 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.955+0000 7f35437fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7a6fc0 0x794d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44320/0 (socket says 172.21.15.121:44320) 2024-09-16T07:49:55.955 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.955+0000 7f35437fe640 1 -- 172.21.15.121:0/3161678036 learned_addr learned my addr 172.21.15.121:0/3161678036 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:49:55.955 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.955+0000 7f35437fe640 1 -- 172.21.15.121:0/3161678036 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x6afe10 con 0x7a6fc0 2024-09-16T07:49:55.955 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.955+0000 7f35437fe640 1 --2- 172.21.15.121:0/3161678036 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7a6fc0 0x794d80 crc :-1 s=READY pgs=12877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3df1e85f31d6ccf2 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:49:55.955 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.956+0000 7f3541ffb640 1 -- 172.21.15.121:0/3161678036 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f353000b580 con 0x7a6fc0 2024-09-16T07:49:55.955 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.956+0000 7f3541ffb640 1 -- 172.21.15.121:0/3161678036 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f353000b6e0 con 0x7a6fc0 2024-09-16T07:49:55.955 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.956+0000 7f3541ffb640 1 -- 172.21.15.121:0/3161678036 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f353000b980 con 0x7a6fc0 2024-09-16T07:49:55.956 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.956+0000 7f354f922ec0 1 -- 172.21.15.121:0/3161678036 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7a6fc0 msgr2=0x794d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:49:55.956 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.956+0000 7f354f922ec0 1 --2- 172.21.15.121:0/3161678036 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7a6fc0 0x794d80 crc :-1 s=READY pgs=12877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:55.956 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.956+0000 7f354f922ec0 1 -- 172.21.15.121:0/3161678036 shutdown_connections 2024-09-16T07:49:55.956 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.956+0000 7f354f922ec0 1 --2- 172.21.15.121:0/3161678036 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7a6fc0 0x794d80 unknown :-1 s=CLOSED pgs=12877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:55.956 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.956+0000 7f354f922ec0 1 -- 172.21.15.121:0/3161678036 >> 172.21.15.121:0/3161678036 conn(0x6d3770 msgr2=0x7a8700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:49:55.956 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.956+0000 7f354f922ec0 1 -- 172.21.15.121:0/3161678036 shutdown_connections 2024-09-16T07:49:55.956 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.956+0000 7f354f922ec0 1 -- 172.21.15.121:0/3161678036 wait complete. 2024-09-16T07:49:55.957 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.957+0000 7f354f922ec0 1 Processor -- start 2024-09-16T07:49:55.957 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.957+0000 7f354f922ec0 1 -- start start 2024-09-16T07:49:55.960 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.958+0000 7f354f922ec0 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7a6fc0 0x8cb900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:49:55.960 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.958+0000 7f354f922ec0 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x711280 con 0x7a6fc0 2024-09-16T07:49:55.960 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.958+0000 7f35437fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7a6fc0 0x8cb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:49:55.960 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.958+0000 7f35437fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7a6fc0 0x8cb900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44330/0 (socket says 172.21.15.121:44330) 2024-09-16T07:49:55.960 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.958+0000 7f35437fe640 1 -- 172.21.15.121:0/3200320475 learned_addr learned my addr 172.21.15.121:0/3200320475 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:49:55.960 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.958+0000 7f35437fe640 1 -- 172.21.15.121:0/3200320475 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x6a1920 con 0x7a6fc0 2024-09-16T07:49:55.960 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.958+0000 7f35437fe640 1 --2- 172.21.15.121:0/3200320475 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7a6fc0 0x8cb900 crc :-1 s=READY pgs=12878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:49:55.960 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.959+0000 7f3540ff9640 1 -- 172.21.15.121:0/3200320475 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3530012b10 con 0x7a6fc0 2024-09-16T07:49:55.960 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.959+0000 7f3540ff9640 1 -- 172.21.15.121:0/3200320475 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f3530005040 con 0x7a6fc0 2024-09-16T07:49:55.961 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.959+0000 7f354f922ec0 1 -- 172.21.15.121:0/3200320475 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x6a1380 con 0x7a6fc0 2024-09-16T07:49:55.961 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.959+0000 7f3540ff9640 1 -- 172.21.15.121:0/3200320475 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3530012da0 con 0x7a6fc0 2024-09-16T07:49:55.961 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.959+0000 7f354f922ec0 1 -- 172.21.15.121:0/3200320475 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x8cc9e0 con 0x7a6fc0 2024-09-16T07:49:55.961 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.960+0000 7f3540ff9640 1 -- 172.21.15.121:0/3200320475 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f353000d040 con 0x7a6fc0 2024-09-16T07:49:55.961 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.960+0000 7f3540ff9640 1 --2- 172.21.15.121:0/3200320475 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f352c03d1c0 0x7f352c03f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:49:55.961 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.960+0000 7f3540ff9640 1 -- 172.21.15.121:0/3200320475 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(697..697 src has 620..697) ==== 3819+0+0 (crc 0 0 0) 0x7f353000a040 con 0x7a6fc0 2024-09-16T07:49:55.961 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.960+0000 7f354f922ec0 1 --2- 172.21.15.121:0/3200320475 >> v2:172.21.15.172:6808/3418488586 conn(0x7af300 0x8b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:49:55.961 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.960+0000 7f354f922ec0 1 -- 172.21.15.121:0/3200320475 --> v2:172.21.15.172:6808/3418488586 -- osd_op(unknown.0.0:1 199.3 199:c52c9666:::obj5:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e697) -- 0x8b6230 con 0x7af300 2024-09-16T07:49:55.961 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.960+0000 7f3542ffd640 1 --2- 172.21.15.121:0/3200320475 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f352c03d1c0 0x7f352c03f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:49:55.961 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.961+0000 7f3542ffd640 1 --2- 172.21.15.121:0/3200320475 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f352c03d1c0 0x7f352c03f6d0 crc :-1 s=READY pgs=3812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:49:55.961 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.961+0000 7f3543fff640 1 --2- 172.21.15.121:0/3200320475 >> v2:172.21.15.172:6808/3418488586 conn(0x7af300 0x8b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T07:49:55.964 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.966+0000 7f3543fff640 1 --2- 172.21.15.121:0/3200320475 >> v2:172.21.15.172:6808/3418488586 conn(0x7af300 0x8b3c80 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:49:55.982 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.982+0000 7f3543fff640 1 -- 172.21.15.121:0/3200320475 <== osd.3 v2:172.21.15.172:6808/3418488586 1 ==== osd_op_reply(1 obj5 [writefull 0~12875] v697'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f353800a430 con 0x7af300 2024-09-16T07:49:55.982 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.982+0000 7f354f922ec0 1 -- 172.21.15.121:0/3200320475 >> v2:172.21.15.172:6808/3418488586 conn(0x7af300 msgr2=0x8b3c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:49:55.982 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.982+0000 7f354f922ec0 1 --2- 172.21.15.121:0/3200320475 >> v2:172.21.15.172:6808/3418488586 conn(0x7af300 0x8b3c80 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:55.982 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.982+0000 7f354f922ec0 1 -- 172.21.15.121:0/3200320475 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f352c03d1c0 msgr2=0x7f352c03f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:49:55.982 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.982+0000 7f354f922ec0 1 --2- 172.21.15.121:0/3200320475 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f352c03d1c0 0x7f352c03f6d0 crc :-1 s=READY pgs=3812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:55.982 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.982+0000 7f354f922ec0 1 -- 172.21.15.121:0/3200320475 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7a6fc0 msgr2=0x8cb900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:49:55.982 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.982+0000 7f354f922ec0 1 --2- 172.21.15.121:0/3200320475 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7a6fc0 0x8cb900 crc :-1 s=READY pgs=12878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:55.982 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.983+0000 7f354f922ec0 1 -- 172.21.15.121:0/3200320475 shutdown_connections 2024-09-16T07:49:55.983 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.983+0000 7f354f922ec0 1 --2- 172.21.15.121:0/3200320475 >> v2:172.21.15.172:6808/3418488586 conn(0x7af300 0x8b3c80 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:55.983 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.983+0000 7f354f922ec0 1 --2- 172.21.15.121:0/3200320475 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f352c03d1c0 0x7f352c03f6d0 unknown :-1 s=CLOSED pgs=3812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:55.983 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.983+0000 7f354f922ec0 1 --2- 172.21.15.121:0/3200320475 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7a6fc0 0x8cb900 unknown :-1 s=CLOSED pgs=12878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:55.983 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.983+0000 7f354f922ec0 1 -- 172.21.15.121:0/3200320475 >> 172.21.15.121:0/3200320475 conn(0x6d3770 msgr2=0x7a9e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:49:55.983 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.983+0000 7f354f922ec0 1 -- 172.21.15.121:0/3200320475 shutdown_connections 2024-09-16T07:49:55.983 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:55.983+0000 7f354f922ec0 1 -- 172.21.15.121:0/3200320475 wait complete. 2024-09-16T07:49:55.983 INFO:tasks.workunit.client.0.smithi121.stderr:+ for f in `seq 1 10` 2024-09-16T07:49:55.984 INFO:tasks.workunit.client.0.smithi121.stderr:+ rados -p 989b9542-ea3d-4c5c-8f96-23ff25b76fb1 put obj6 /etc/passwd 2024-09-16T07:49:56.019 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.020+0000 7fcb4e6fcec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:56.024 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.025+0000 7fcb4e6fcec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:56.024 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.025+0000 7fcb4e6fcec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:56.025 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.026+0000 7fcb4e6fcec0 1 Processor -- start 2024-09-16T07:49:56.025 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.026+0000 7fcb4e6fcec0 1 -- start start 2024-09-16T07:49:56.026 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.027+0000 7fcb4e6fcec0 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x15199b0 0x147edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:49:56.027 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.027+0000 7fcb4e6fcec0 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x13eb520 con 0x15199b0 2024-09-16T07:49:56.027 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.027+0000 7fcb46b9b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x15199b0 0x147edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:49:56.027 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.027+0000 7fcb46b9b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x15199b0 0x147edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44342/0 (socket says 172.21.15.121:44342) 2024-09-16T07:49:56.027 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.027+0000 7fcb46b9b640 1 -- 172.21.15.121:0/2724038895 learned_addr learned my addr 172.21.15.121:0/2724038895 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:49:56.027 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.027+0000 7fcb46b9b640 1 -- 172.21.15.121:0/2724038895 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1387e10 con 0x15199b0 2024-09-16T07:49:56.027 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.028+0000 7fcb46b9b640 1 --2- 172.21.15.121:0/2724038895 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x15199b0 0x147edb0 crc :-1 s=READY pgs=12881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ec65c07466fc812 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:49:56.027 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.028+0000 7fcb45398640 1 -- 172.21.15.121:0/2724038895 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fcb3002db60 con 0x15199b0 2024-09-16T07:49:56.027 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.028+0000 7fcb45398640 1 -- 172.21.15.121:0/2724038895 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fcb30037370 con 0x15199b0 2024-09-16T07:49:56.027 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.028+0000 7fcb45398640 1 -- 172.21.15.121:0/2724038895 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fcb30037610 con 0x15199b0 2024-09-16T07:49:56.028 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.028+0000 7fcb4e6fcec0 1 -- 172.21.15.121:0/2724038895 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x15199b0 msgr2=0x147edb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:49:56.028 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.028+0000 7fcb4e6fcec0 1 --2- 172.21.15.121:0/2724038895 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x15199b0 0x147edb0 crc :-1 s=READY pgs=12881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:56.029 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.028+0000 7fcb4e6fcec0 1 -- 172.21.15.121:0/2724038895 shutdown_connections 2024-09-16T07:49:56.029 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.028+0000 7fcb4e6fcec0 1 --2- 172.21.15.121:0/2724038895 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x15199b0 0x147edb0 unknown :-1 s=CLOSED pgs=12881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:56.029 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.028+0000 7fcb4e6fcec0 1 -- 172.21.15.121:0/2724038895 >> 172.21.15.121:0/2724038895 conn(0x13ab770 msgr2=0x1484230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:49:56.029 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.028+0000 7fcb4e6fcec0 1 -- 172.21.15.121:0/2724038895 shutdown_connections 2024-09-16T07:49:56.029 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.028+0000 7fcb4e6fcec0 1 -- 172.21.15.121:0/2724038895 wait complete. 2024-09-16T07:49:56.029 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.029+0000 7fcb4e6fcec0 1 Processor -- start 2024-09-16T07:49:56.029 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.029+0000 7fcb4e6fcec0 1 -- start start 2024-09-16T07:49:56.031 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.030+0000 7fcb4e6fcec0 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x15199b0 0x150a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:49:56.031 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.030+0000 7fcb4e6fcec0 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x13e9280 con 0x15199b0 2024-09-16T07:49:56.031 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.030+0000 7fcb46b9b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x15199b0 0x150a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:49:56.031 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.030+0000 7fcb46b9b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x15199b0 0x150a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44346/0 (socket says 172.21.15.121:44346) 2024-09-16T07:49:56.031 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.030+0000 7fcb46b9b640 1 -- 172.21.15.121:0/3043127443 learned_addr learned my addr 172.21.15.121:0/3043127443 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:49:56.031 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.031+0000 7fcb46b9b640 1 -- 172.21.15.121:0/3043127443 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1379920 con 0x15199b0 2024-09-16T07:49:56.031 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.031+0000 7fcb46b9b640 1 --2- 172.21.15.121:0/3043127443 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x15199b0 0x150a2b0 crc :-1 s=READY pgs=12882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:49:56.031 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.031+0000 7fcb3ffff640 1 -- 172.21.15.121:0/3043127443 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fcb30037d60 con 0x15199b0 2024-09-16T07:49:56.032 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.031+0000 7fcb3ffff640 1 -- 172.21.15.121:0/3043127443 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fcb30037ec0 con 0x15199b0 2024-09-16T07:49:56.032 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.031+0000 7fcb4e6fcec0 1 -- 172.21.15.121:0/3043127443 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1379380 con 0x15199b0 2024-09-16T07:49:56.032 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.031+0000 7fcb3ffff640 1 -- 172.21.15.121:0/3043127443 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fcb30039580 con 0x15199b0 2024-09-16T07:49:56.032 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.031+0000 7fcb4e6fcec0 1 -- 172.21.15.121:0/3043127443 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x150e120 con 0x15199b0 2024-09-16T07:49:56.032 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.032+0000 7fcb3ffff640 1 -- 172.21.15.121:0/3043127443 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fcb30039730 con 0x15199b0 2024-09-16T07:49:56.032 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.032+0000 7fcb3ffff640 1 --2- 172.21.15.121:0/3043127443 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fcb2c03d1c0 0x7fcb2c03f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:49:56.032 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.032+0000 7fcb3ffff640 1 -- 172.21.15.121:0/3043127443 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(697..697 src has 620..697) ==== 3819+0+0 (crc 0 0 0) 0x7fcb30032040 con 0x15199b0 2024-09-16T07:49:56.033 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.032+0000 7fcb4e6fcec0 1 --2- 172.21.15.121:0/3043127443 >> v2:172.21.15.121:6808/3193900849 conn(0x151a300 0x15b09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:49:56.033 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.032+0000 7fcb4e6fcec0 1 -- 172.21.15.121:0/3043127443 --> v2:172.21.15.121:6808/3193900849 -- osd_op(unknown.0.0:1 199.4 199:233a42c1:::obj6:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e697) -- 0x150dcb0 con 0x151a300 2024-09-16T07:49:56.033 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.032+0000 7fcb4639a640 1 --2- 172.21.15.121:0/3043127443 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fcb2c03d1c0 0x7fcb2c03f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:49:56.033 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.033+0000 7fcb4639a640 1 --2- 172.21.15.121:0/3043127443 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fcb2c03d1c0 0x7fcb2c03f6d0 crc :-1 s=READY pgs=3813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:49:56.033 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.033+0000 7fcb4739c640 1 --2- 172.21.15.121:0/3043127443 >> v2:172.21.15.121:6808/3193900849 conn(0x151a300 0x15b09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T07:49:56.035 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.037+0000 7fcb4739c640 1 --2- 172.21.15.121:0/3043127443 >> v2:172.21.15.121:6808/3193900849 conn(0x151a300 0x15b09f0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:49:56.051 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.052+0000 7fcb4739c640 1 -- 172.21.15.121:0/3043127443 <== osd.0 v2:172.21.15.121:6808/3193900849 1 ==== osd_op_reply(1 obj6 [writefull 0~12875] v697'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fcb3800a430 con 0x151a300 2024-09-16T07:49:56.051 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.052+0000 7fcb4e6fcec0 1 -- 172.21.15.121:0/3043127443 >> v2:172.21.15.121:6808/3193900849 conn(0x151a300 msgr2=0x15b09f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:49:56.052 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.052+0000 7fcb4e6fcec0 1 --2- 172.21.15.121:0/3043127443 >> v2:172.21.15.121:6808/3193900849 conn(0x151a300 0x15b09f0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:56.052 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.052+0000 7fcb4e6fcec0 1 -- 172.21.15.121:0/3043127443 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fcb2c03d1c0 msgr2=0x7fcb2c03f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:49:56.052 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.052+0000 7fcb4e6fcec0 1 --2- 172.21.15.121:0/3043127443 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fcb2c03d1c0 0x7fcb2c03f6d0 crc :-1 s=READY pgs=3813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:56.052 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.052+0000 7fcb4e6fcec0 1 -- 172.21.15.121:0/3043127443 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x15199b0 msgr2=0x150a2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:49:56.052 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.052+0000 7fcb4e6fcec0 1 --2- 172.21.15.121:0/3043127443 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x15199b0 0x150a2b0 crc :-1 s=READY pgs=12882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:56.052 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.052+0000 7fcb4e6fcec0 1 -- 172.21.15.121:0/3043127443 shutdown_connections 2024-09-16T07:49:56.052 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.052+0000 7fcb4e6fcec0 1 --2- 172.21.15.121:0/3043127443 >> v2:172.21.15.121:6808/3193900849 conn(0x151a300 0x15b09f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:56.052 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.052+0000 7fcb4e6fcec0 1 --2- 172.21.15.121:0/3043127443 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fcb2c03d1c0 0x7fcb2c03f6d0 unknown :-1 s=CLOSED pgs=3813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:56.052 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.052+0000 7fcb4e6fcec0 1 --2- 172.21.15.121:0/3043127443 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x15199b0 0x150a2b0 unknown :-1 s=CLOSED pgs=12882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:56.052 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.052+0000 7fcb4e6fcec0 1 -- 172.21.15.121:0/3043127443 >> 172.21.15.121:0/3043127443 conn(0x13ab770 msgr2=0x1482a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:49:56.052 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.052+0000 7fcb4e6fcec0 1 -- 172.21.15.121:0/3043127443 shutdown_connections 2024-09-16T07:49:56.052 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.052+0000 7fcb4e6fcec0 1 -- 172.21.15.121:0/3043127443 wait complete. 2024-09-16T07:49:56.053 INFO:tasks.workunit.client.0.smithi121.stderr:+ for f in `seq 1 10` 2024-09-16T07:49:56.053 INFO:tasks.workunit.client.0.smithi121.stderr:+ rados -p 989b9542-ea3d-4c5c-8f96-23ff25b76fb1 put obj7 /etc/passwd 2024-09-16T07:49:56.090 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.092+0000 7fc7eb231ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:56.095 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.097+0000 7fc7eb231ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:56.096 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.097+0000 7fc7eb231ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:56.097 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.097+0000 7fc7eb231ec0 1 Processor -- start 2024-09-16T07:49:56.097 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.097+0000 7fc7eb231ec0 1 -- start start 2024-09-16T07:49:56.098 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.098+0000 7fc7eb231ec0 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xb789b0 0xae99b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:49:56.098 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.098+0000 7fc7eb231ec0 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0xa4a520 con 0xb789b0 2024-09-16T07:49:56.098 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.099+0000 7fc7e323f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xb789b0 0xae99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:49:56.098 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.099+0000 7fc7e323f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xb789b0 0xae99b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44364/0 (socket says 172.21.15.121:44364) 2024-09-16T07:49:56.098 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.099+0000 7fc7e323f640 1 -- 172.21.15.121:0/2888812304 learned_addr learned my addr 172.21.15.121:0/2888812304 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:49:56.098 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.099+0000 7fc7e323f640 1 -- 172.21.15.121:0/2888812304 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x9e6e10 con 0xb789b0 2024-09-16T07:49:56.098 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.099+0000 7fc7e323f640 1 --2- 172.21.15.121:0/2888812304 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xb789b0 0xae99b0 crc :-1 s=READY pgs=12885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54ced4c85aad790c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:49:56.098 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.099+0000 7fc7e1a3c640 1 -- 172.21.15.121:0/2888812304 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc7d40061f0 con 0xb789b0 2024-09-16T07:49:56.098 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.099+0000 7fc7e1a3c640 1 -- 172.21.15.121:0/2888812304 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc7d4001980 con 0xb789b0 2024-09-16T07:49:56.099 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.099+0000 7fc7e1a3c640 1 -- 172.21.15.121:0/2888812304 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc7d4001af0 con 0xb789b0 2024-09-16T07:49:56.100 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.100+0000 7fc7eb231ec0 1 -- 172.21.15.121:0/2888812304 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xb789b0 msgr2=0xae99b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:49:56.100 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.100+0000 7fc7eb231ec0 1 --2- 172.21.15.121:0/2888812304 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xb789b0 0xae99b0 crc :-1 s=READY pgs=12885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:56.100 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.100+0000 7fc7eb231ec0 1 -- 172.21.15.121:0/2888812304 shutdown_connections 2024-09-16T07:49:56.100 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.100+0000 7fc7eb231ec0 1 --2- 172.21.15.121:0/2888812304 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xb789b0 0xae99b0 unknown :-1 s=CLOSED pgs=12885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:56.100 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.100+0000 7fc7eb231ec0 1 -- 172.21.15.121:0/2888812304 >> 172.21.15.121:0/2888812304 conn(0xa0a770 msgr2=0xae1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:49:56.100 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.100+0000 7fc7eb231ec0 1 -- 172.21.15.121:0/2888812304 shutdown_connections 2024-09-16T07:49:56.100 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.100+0000 7fc7eb231ec0 1 -- 172.21.15.121:0/2888812304 wait complete. 2024-09-16T07:49:56.100 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.100+0000 7fc7eb231ec0 1 Processor -- start 2024-09-16T07:49:56.100 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.101+0000 7fc7eb231ec0 1 -- start start 2024-09-16T07:49:56.102 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.102+0000 7fc7eb231ec0 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xb789b0 0xc0d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:49:56.102 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.102+0000 7fc7eb231ec0 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0xa48280 con 0xb789b0 2024-09-16T07:49:56.102 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.102+0000 7fc7e323f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xb789b0 0xc0d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:49:56.103 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.102+0000 7fc7e323f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xb789b0 0xc0d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44370/0 (socket says 172.21.15.121:44370) 2024-09-16T07:49:56.103 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.102+0000 7fc7e323f640 1 -- 172.21.15.121:0/362587708 learned_addr learned my addr 172.21.15.121:0/362587708 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:49:56.103 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.102+0000 7fc7e323f640 1 -- 172.21.15.121:0/362587708 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x9d8920 con 0xb789b0 2024-09-16T07:49:56.103 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.102+0000 7fc7e323f640 1 --2- 172.21.15.121:0/362587708 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xb789b0 0xc0d500 crc :-1 s=READY pgs=12886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:49:56.103 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.102+0000 7fc7e0a3a640 1 -- 172.21.15.121:0/362587708 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc7d4011d70 con 0xb789b0 2024-09-16T07:49:56.103 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.102+0000 7fc7e0a3a640 1 -- 172.21.15.121:0/362587708 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc7d4012330 con 0xb789b0 2024-09-16T07:49:56.103 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.102+0000 7fc7eb231ec0 1 -- 172.21.15.121:0/362587708 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x9d8380 con 0xb789b0 2024-09-16T07:49:56.103 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.102+0000 7fc7e0a3a640 1 -- 172.21.15.121:0/362587708 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc7d40124a0 con 0xb789b0 2024-09-16T07:49:56.103 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.102+0000 7fc7eb231ec0 1 -- 172.21.15.121:0/362587708 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0xb64640 con 0xb789b0 2024-09-16T07:49:56.103 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.103+0000 7fc7e0a3a640 1 -- 172.21.15.121:0/362587708 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fc7d4012650 con 0xb789b0 2024-09-16T07:49:56.103 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.103+0000 7fc7e0a3a640 1 --2- 172.21.15.121:0/362587708 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fc7bc03d1c0 0x7fc7bc03f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:49:56.104 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.103+0000 7fc7e0a3a640 1 -- 172.21.15.121:0/362587708 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(697..697 src has 620..697) ==== 3819+0+0 (crc 0 0 0) 0x7fc7d404f970 con 0xb789b0 2024-09-16T07:49:56.104 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.104+0000 7fc7eb231ec0 1 --2- 172.21.15.121:0/362587708 >> v2:172.21.15.121:6801/4208564222 conn(0xb794d0 0xb77600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:49:56.104 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.104+0000 7fc7eb231ec0 1 -- 172.21.15.121:0/362587708 --> v2:172.21.15.121:6801/4208564222 -- osd_op(unknown.0.0:1 199.9 199:9a09113a:::obj7:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e697) -- 0xb67ae0 con 0xb794d0 2024-09-16T07:49:56.104 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.104+0000 7fc7e2a3e640 1 --2- 172.21.15.121:0/362587708 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fc7bc03d1c0 0x7fc7bc03f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:49:56.104 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.104+0000 7fc7e2a3e640 1 --2- 172.21.15.121:0/362587708 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fc7bc03d1c0 0x7fc7bc03f6d0 crc :-1 s=READY pgs=3814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:49:56.104 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.104+0000 7fc7e3a40640 1 --2- 172.21.15.121:0/362587708 >> v2:172.21.15.121:6801/4208564222 conn(0xb794d0 0xb77600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T07:49:56.105 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.107+0000 7fc7e3a40640 1 --2- 172.21.15.121:0/362587708 >> v2:172.21.15.121:6801/4208564222 conn(0xb794d0 0xb77600 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:49:56.122 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.122+0000 7fc7e3a40640 1 -- 172.21.15.121:0/362587708 <== osd.1 v2:172.21.15.121:6801/4208564222 1 ==== osd_op_reply(1 obj7 [writefull 0~12875] v697'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fc7cc00c430 con 0xb794d0 2024-09-16T07:49:56.122 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.122+0000 7fc7eb231ec0 1 -- 172.21.15.121:0/362587708 >> v2:172.21.15.121:6801/4208564222 conn(0xb794d0 msgr2=0xb77600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:49:56.122 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.123+0000 7fc7eb231ec0 1 --2- 172.21.15.121:0/362587708 >> v2:172.21.15.121:6801/4208564222 conn(0xb794d0 0xb77600 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:56.122 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.123+0000 7fc7eb231ec0 1 -- 172.21.15.121:0/362587708 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fc7bc03d1c0 msgr2=0x7fc7bc03f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:49:56.123 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.123+0000 7fc7eb231ec0 1 --2- 172.21.15.121:0/362587708 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fc7bc03d1c0 0x7fc7bc03f6d0 crc :-1 s=READY pgs=3814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:56.123 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.123+0000 7fc7eb231ec0 1 -- 172.21.15.121:0/362587708 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xb789b0 msgr2=0xc0d500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:49:56.123 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.123+0000 7fc7eb231ec0 1 --2- 172.21.15.121:0/362587708 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xb789b0 0xc0d500 crc :-1 s=READY pgs=12886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:56.123 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.123+0000 7fc7eb231ec0 1 -- 172.21.15.121:0/362587708 shutdown_connections 2024-09-16T07:49:56.123 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.123+0000 7fc7eb231ec0 1 --2- 172.21.15.121:0/362587708 >> v2:172.21.15.121:6801/4208564222 conn(0xb794d0 0xb77600 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:56.123 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.123+0000 7fc7eb231ec0 1 --2- 172.21.15.121:0/362587708 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fc7bc03d1c0 0x7fc7bc03f6d0 unknown :-1 s=CLOSED pgs=3814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:56.123 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.123+0000 7fc7eb231ec0 1 --2- 172.21.15.121:0/362587708 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xb789b0 0xc0d500 unknown :-1 s=CLOSED pgs=12886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:56.123 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.123+0000 7fc7eb231ec0 1 -- 172.21.15.121:0/362587708 >> 172.21.15.121:0/362587708 conn(0xa0a770 msgr2=0xae1930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:49:56.123 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.123+0000 7fc7eb231ec0 1 -- 172.21.15.121:0/362587708 shutdown_connections 2024-09-16T07:49:56.123 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.123+0000 7fc7eb231ec0 1 -- 172.21.15.121:0/362587708 wait complete. 2024-09-16T07:49:56.124 INFO:tasks.workunit.client.0.smithi121.stderr:+ for f in `seq 1 10` 2024-09-16T07:49:56.124 INFO:tasks.workunit.client.0.smithi121.stderr:+ rados -p 989b9542-ea3d-4c5c-8f96-23ff25b76fb1 put obj8 /etc/passwd 2024-09-16T07:49:56.160 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.161+0000 7ff4ee82cec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:56.165 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.167+0000 7ff4ee82cec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:56.166 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.167+0000 7ff4ee82cec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:56.166 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.167+0000 7ff4ee82cec0 1 Processor -- start 2024-09-16T07:49:56.166 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.167+0000 7ff4ee82cec0 1 -- start start 2024-09-16T07:49:56.168 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.168+0000 7ff4ee82cec0 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x12879b0 0x130f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:49:56.168 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.168+0000 7ff4ee82cec0 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x1159520 con 0x12879b0 2024-09-16T07:49:56.168 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.168+0000 7ff4e699b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x12879b0 0x130f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:49:56.168 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.168+0000 7ff4e699b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x12879b0 0x130f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44378/0 (socket says 172.21.15.121:44378) 2024-09-16T07:49:56.168 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.168+0000 7ff4e699b640 1 -- 172.21.15.121:0/1900907666 learned_addr learned my addr 172.21.15.121:0/1900907666 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:49:56.169 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.169+0000 7ff4e699b640 1 -- 172.21.15.121:0/1900907666 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x10f5e10 con 0x12879b0 2024-09-16T07:49:56.169 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.169+0000 7ff4e699b640 1 --2- 172.21.15.121:0/1900907666 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x12879b0 0x130f8f0 crc :-1 s=READY pgs=12889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d02bc3f49215574 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:49:56.169 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.169+0000 7ff4e5198640 1 -- 172.21.15.121:0/1900907666 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff4d00061e0 con 0x12879b0 2024-09-16T07:49:56.169 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.169+0000 7ff4e5198640 1 -- 172.21.15.121:0/1900907666 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff4d0001960 con 0x12879b0 2024-09-16T07:49:56.169 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.169+0000 7ff4e5198640 1 -- 172.21.15.121:0/1900907666 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff4d0006340 con 0x12879b0 2024-09-16T07:49:56.171 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.170+0000 7ff4ee82cec0 1 -- 172.21.15.121:0/1900907666 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x12879b0 msgr2=0x130f8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:49:56.171 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.170+0000 7ff4ee82cec0 1 --2- 172.21.15.121:0/1900907666 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x12879b0 0x130f8f0 crc :-1 s=READY pgs=12889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:56.171 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.170+0000 7ff4ee82cec0 1 -- 172.21.15.121:0/1900907666 shutdown_connections 2024-09-16T07:49:56.171 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.170+0000 7ff4ee82cec0 1 --2- 172.21.15.121:0/1900907666 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x12879b0 0x130f8f0 unknown :-1 s=CLOSED pgs=12889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:56.172 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.170+0000 7ff4ee82cec0 1 -- 172.21.15.121:0/1900907666 >> 172.21.15.121:0/1900907666 conn(0x1119770 msgr2=0x11f22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:49:56.172 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.170+0000 7ff4ee82cec0 1 -- 172.21.15.121:0/1900907666 shutdown_connections 2024-09-16T07:49:56.172 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.170+0000 7ff4ee82cec0 1 -- 172.21.15.121:0/1900907666 wait complete. 2024-09-16T07:49:56.172 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.170+0000 7ff4ee82cec0 1 Processor -- start 2024-09-16T07:49:56.172 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.170+0000 7ff4ee82cec0 1 -- start start 2024-09-16T07:49:56.172 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.171+0000 7ff4ee82cec0 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x12879b0 0x131c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:49:56.172 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.171+0000 7ff4ee82cec0 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x1157280 con 0x12879b0 2024-09-16T07:49:56.172 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.172+0000 7ff4e699b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x12879b0 0x131c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:49:56.172 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.172+0000 7ff4e699b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x12879b0 0x131c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44390/0 (socket says 172.21.15.121:44390) 2024-09-16T07:49:56.172 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.172+0000 7ff4e699b640 1 -- 172.21.15.121:0/4026285715 learned_addr learned my addr 172.21.15.121:0/4026285715 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:49:56.172 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.172+0000 7ff4e699b640 1 -- 172.21.15.121:0/4026285715 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x10e7920 con 0x12879b0 2024-09-16T07:49:56.172 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.172+0000 7ff4e699b640 1 --2- 172.21.15.121:0/4026285715 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x12879b0 0x131c880 crc :-1 s=READY pgs=12890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:49:56.173 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.172+0000 7ff4dffff640 1 -- 172.21.15.121:0/4026285715 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff4d00048c0 con 0x12879b0 2024-09-16T07:49:56.173 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.172+0000 7ff4dffff640 1 -- 172.21.15.121:0/4026285715 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff4d0004a20 con 0x12879b0 2024-09-16T07:49:56.173 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.172+0000 7ff4ee82cec0 1 -- 172.21.15.121:0/4026285715 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x10e7380 con 0x12879b0 2024-09-16T07:49:56.173 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.172+0000 7ff4dffff640 1 -- 172.21.15.121:0/4026285715 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff4d0004cc0 con 0x12879b0 2024-09-16T07:49:56.173 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.172+0000 7ff4ee82cec0 1 -- 172.21.15.121:0/4026285715 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1287520 con 0x12879b0 2024-09-16T07:49:56.174 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.173+0000 7ff4dffff640 1 -- 172.21.15.121:0/4026285715 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7ff4d0014410 con 0x12879b0 2024-09-16T07:49:56.174 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.173+0000 7ff4dffff640 1 --2- 172.21.15.121:0/4026285715 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7ff4cc03d1c0 0x7ff4cc03f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:49:56.174 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.173+0000 7ff4dffff640 1 -- 172.21.15.121:0/4026285715 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(697..697 src has 620..697) ==== 3819+0+0 (crc 0 0 0) 0x7ff4d004fc20 con 0x12879b0 2024-09-16T07:49:56.174 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.174+0000 7ff4ee82cec0 1 --2- 172.21.15.121:0/4026285715 >> v2:172.21.15.172:6804/2274906412 conn(0x12884d0 0x1286460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:49:56.174 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.174+0000 7ff4ee82cec0 1 -- 172.21.15.121:0/4026285715 --> v2:172.21.15.172:6804/2274906412 -- osd_op(unknown.0.0:1 199.5 199:a557efb1:::obj8:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e697) -- 0x1276af0 con 0x12884d0 2024-09-16T07:49:56.174 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.174+0000 7ff4e619a640 1 --2- 172.21.15.121:0/4026285715 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7ff4cc03d1c0 0x7ff4cc03f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:49:56.174 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.174+0000 7ff4e619a640 1 --2- 172.21.15.121:0/4026285715 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7ff4cc03d1c0 0x7ff4cc03f6d0 crc :-1 s=READY pgs=3815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:49:56.175 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.175+0000 7ff4e719c640 1 --2- 172.21.15.121:0/4026285715 >> v2:172.21.15.172:6804/2274906412 conn(0x12884d0 0x1286460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T07:49:56.178 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.179+0000 7ff4e719c640 1 --2- 172.21.15.121:0/4026285715 >> v2:172.21.15.172:6804/2274906412 conn(0x12884d0 0x1286460 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:49:56.194 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.194+0000 7ff4e719c640 1 -- 172.21.15.121:0/4026285715 <== osd.2 v2:172.21.15.172:6804/2274906412 1 ==== osd_op_reply(1 obj8 [writefull 0~12875] v697'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7ff4d800c430 con 0x12884d0 2024-09-16T07:49:56.194 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.194+0000 7ff4ee82cec0 1 -- 172.21.15.121:0/4026285715 >> v2:172.21.15.172:6804/2274906412 conn(0x12884d0 msgr2=0x1286460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:49:56.194 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.194+0000 7ff4ee82cec0 1 --2- 172.21.15.121:0/4026285715 >> v2:172.21.15.172:6804/2274906412 conn(0x12884d0 0x1286460 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:56.194 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.195+0000 7ff4ee82cec0 1 -- 172.21.15.121:0/4026285715 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7ff4cc03d1c0 msgr2=0x7ff4cc03f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:49:56.194 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.195+0000 7ff4ee82cec0 1 --2- 172.21.15.121:0/4026285715 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7ff4cc03d1c0 0x7ff4cc03f6d0 crc :-1 s=READY pgs=3815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:56.194 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.195+0000 7ff4ee82cec0 1 -- 172.21.15.121:0/4026285715 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x12879b0 msgr2=0x131c880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:49:56.194 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.195+0000 7ff4ee82cec0 1 --2- 172.21.15.121:0/4026285715 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x12879b0 0x131c880 crc :-1 s=READY pgs=12890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:56.194 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.195+0000 7ff4ee82cec0 1 -- 172.21.15.121:0/4026285715 shutdown_connections 2024-09-16T07:49:56.194 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.195+0000 7ff4ee82cec0 1 --2- 172.21.15.121:0/4026285715 >> v2:172.21.15.172:6804/2274906412 conn(0x12884d0 0x1286460 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:56.195 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.195+0000 7ff4ee82cec0 1 --2- 172.21.15.121:0/4026285715 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7ff4cc03d1c0 0x7ff4cc03f6d0 unknown :-1 s=CLOSED pgs=3815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:56.195 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.195+0000 7ff4ee82cec0 1 --2- 172.21.15.121:0/4026285715 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x12879b0 0x131c880 unknown :-1 s=CLOSED pgs=12890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:56.195 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.195+0000 7ff4ee82cec0 1 -- 172.21.15.121:0/4026285715 >> 172.21.15.121:0/4026285715 conn(0x1119770 msgr2=0x11f22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:49:56.195 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.195+0000 7ff4ee82cec0 1 -- 172.21.15.121:0/4026285715 shutdown_connections 2024-09-16T07:49:56.195 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.195+0000 7ff4ee82cec0 1 -- 172.21.15.121:0/4026285715 wait complete. 2024-09-16T07:49:56.196 INFO:tasks.workunit.client.0.smithi121.stderr:+ for f in `seq 1 10` 2024-09-16T07:49:56.196 INFO:tasks.workunit.client.0.smithi121.stderr:+ rados -p 989b9542-ea3d-4c5c-8f96-23ff25b76fb1 put obj9 /etc/passwd 2024-09-16T07:49:56.233 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.233+0000 7f71a72ebec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:56.237 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.239+0000 7f71a72ebec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:56.238 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.239+0000 7f71a72ebec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:56.238 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.239+0000 7f71a72ebec0 1 Processor -- start 2024-09-16T07:49:56.238 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.239+0000 7f71a72ebec0 1 -- start start 2024-09-16T07:49:56.240 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.241+0000 7f71a72ebec0 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x1040fc0 0x11671b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:49:56.240 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.241+0000 7f71a72ebec0 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0xfad520 con 0x1040fc0 2024-09-16T07:49:56.240 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.241+0000 7f719f63f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x1040fc0 0x11671b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:49:56.240 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.241+0000 7f719f63f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x1040fc0 0x11671b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44400/0 (socket says 172.21.15.121:44400) 2024-09-16T07:49:56.240 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.241+0000 7f719f63f640 1 -- 172.21.15.121:0/2588476156 learned_addr learned my addr 172.21.15.121:0/2588476156 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:49:56.240 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.241+0000 7f719f63f640 1 -- 172.21.15.121:0/2588476156 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xf49e10 con 0x1040fc0 2024-09-16T07:49:56.241 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.241+0000 7f719f63f640 1 --2- 172.21.15.121:0/2588476156 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x1040fc0 0x11671b0 crc :-1 s=READY pgs=12893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=709e4be78e9b232e server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:49:56.241 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.241+0000 7f719de3c640 1 -- 172.21.15.121:0/2588476156 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f718800b580 con 0x1040fc0 2024-09-16T07:49:56.241 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.241+0000 7f719de3c640 1 -- 172.21.15.121:0/2588476156 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f718800b6e0 con 0x1040fc0 2024-09-16T07:49:56.241 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.241+0000 7f719de3c640 1 -- 172.21.15.121:0/2588476156 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f718800b980 con 0x1040fc0 2024-09-16T07:49:56.242 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.242+0000 7f71a72ebec0 1 -- 172.21.15.121:0/2588476156 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x1040fc0 msgr2=0x11671b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:49:56.242 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.242+0000 7f71a72ebec0 1 --2- 172.21.15.121:0/2588476156 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x1040fc0 0x11671b0 crc :-1 s=READY pgs=12893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:56.242 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.242+0000 7f71a72ebec0 1 -- 172.21.15.121:0/2588476156 shutdown_connections 2024-09-16T07:49:56.242 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.242+0000 7f71a72ebec0 1 --2- 172.21.15.121:0/2588476156 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x1040fc0 0x11671b0 unknown :-1 s=CLOSED pgs=12893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:56.242 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.242+0000 7f71a72ebec0 1 -- 172.21.15.121:0/2588476156 >> 172.21.15.121:0/2588476156 conn(0xf6d770 msgr2=0x1042700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:49:56.242 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.242+0000 7f71a72ebec0 1 -- 172.21.15.121:0/2588476156 shutdown_connections 2024-09-16T07:49:56.242 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.242+0000 7f71a72ebec0 1 -- 172.21.15.121:0/2588476156 wait complete. 2024-09-16T07:49:56.242 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.243+0000 7f71a72ebec0 1 Processor -- start 2024-09-16T07:49:56.242 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.243+0000 7f71a72ebec0 1 -- start start 2024-09-16T07:49:56.245 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.244+0000 7f71a72ebec0 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x1040fc0 0x114fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:49:56.245 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.244+0000 7f71a72ebec0 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0xfab280 con 0x1040fc0 2024-09-16T07:49:56.245 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.244+0000 7f719f63f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x1040fc0 0x114fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:49:56.245 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.244+0000 7f719f63f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x1040fc0 0x114fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44406/0 (socket says 172.21.15.121:44406) 2024-09-16T07:49:56.245 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.244+0000 7f719f63f640 1 -- 172.21.15.121:0/2871895275 learned_addr learned my addr 172.21.15.121:0/2871895275 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:49:56.245 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.244+0000 7f719f63f640 1 -- 172.21.15.121:0/2871895275 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xf3b920 con 0x1040fc0 2024-09-16T07:49:56.246 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.244+0000 7f719f63f640 1 --2- 172.21.15.121:0/2871895275 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x1040fc0 0x114fad0 crc :-1 s=READY pgs=12894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:49:56.246 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.244+0000 7f719ce3a640 1 -- 172.21.15.121:0/2871895275 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7188012b10 con 0x1040fc0 2024-09-16T07:49:56.246 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.244+0000 7f719ce3a640 1 -- 172.21.15.121:0/2871895275 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f7188005040 con 0x1040fc0 2024-09-16T07:49:56.246 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.244+0000 7f719ce3a640 1 -- 172.21.15.121:0/2871895275 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7188012da0 con 0x1040fc0 2024-09-16T07:49:56.246 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.244+0000 7f71a72ebec0 1 -- 172.21.15.121:0/2871895275 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0xf3b380 con 0x1040fc0 2024-09-16T07:49:56.246 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.244+0000 7f71a72ebec0 1 -- 172.21.15.121:0/2871895275 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x11658c0 con 0x1040fc0 2024-09-16T07:49:56.246 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.245+0000 7f719ce3a640 1 -- 172.21.15.121:0/2871895275 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f718800d040 con 0x1040fc0 2024-09-16T07:49:56.246 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.246+0000 7f719ce3a640 1 --2- 172.21.15.121:0/2871895275 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f718403d1c0 0x7f718403f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:49:56.246 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.246+0000 7f719ce3a640 1 -- 172.21.15.121:0/2871895275 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(697..697 src has 620..697) ==== 3819+0+0 (crc 0 0 0) 0x7f718800a040 con 0x1040fc0 2024-09-16T07:49:56.246 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.246+0000 7f71a72ebec0 1 --2- 172.21.15.121:0/2871895275 >> v2:172.21.15.121:6808/3193900849 conn(0x1049300 0x114cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:49:56.247 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.246+0000 7f71a72ebec0 1 -- 172.21.15.121:0/2871895275 --> v2:172.21.15.121:6808/3193900849 -- osd_op(unknown.0.0:1 199.7 199:fe351e27:::obj9:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e697) -- 0x114e9b0 con 0x1049300 2024-09-16T07:49:56.247 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.246+0000 7f719ee3e640 1 --2- 172.21.15.121:0/2871895275 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f718403d1c0 0x7f718403f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:49:56.247 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.246+0000 7f719ee3e640 1 --2- 172.21.15.121:0/2871895275 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f718403d1c0 0x7f718403f6d0 crc :-1 s=READY pgs=3816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:49:56.247 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.246+0000 7f719fe40640 1 --2- 172.21.15.121:0/2871895275 >> v2:172.21.15.121:6808/3193900849 conn(0x1049300 0x114cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T07:49:56.248 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.249+0000 7f719fe40640 1 --2- 172.21.15.121:0/2871895275 >> v2:172.21.15.121:6808/3193900849 conn(0x1049300 0x114cf70 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:49:56.262 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.262+0000 7f719fe40640 1 -- 172.21.15.121:0/2871895275 <== osd.0 v2:172.21.15.121:6808/3193900849 1 ==== osd_op_reply(1 obj9 [writefull 0~12875] v697'2 uv2 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f719000a430 con 0x1049300 2024-09-16T07:49:56.262 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.262+0000 7f71a72ebec0 1 -- 172.21.15.121:0/2871895275 >> v2:172.21.15.121:6808/3193900849 conn(0x1049300 msgr2=0x114cf70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:49:56.262 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.262+0000 7f71a72ebec0 1 --2- 172.21.15.121:0/2871895275 >> v2:172.21.15.121:6808/3193900849 conn(0x1049300 0x114cf70 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:56.262 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.263+0000 7f71a72ebec0 1 -- 172.21.15.121:0/2871895275 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f718403d1c0 msgr2=0x7f718403f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:49:56.262 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.263+0000 7f71a72ebec0 1 --2- 172.21.15.121:0/2871895275 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f718403d1c0 0x7f718403f6d0 crc :-1 s=READY pgs=3816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:56.262 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.263+0000 7f71a72ebec0 1 -- 172.21.15.121:0/2871895275 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x1040fc0 msgr2=0x114fad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:49:56.262 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.263+0000 7f71a72ebec0 1 --2- 172.21.15.121:0/2871895275 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x1040fc0 0x114fad0 crc :-1 s=READY pgs=12894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:56.262 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.263+0000 7f71a72ebec0 1 -- 172.21.15.121:0/2871895275 shutdown_connections 2024-09-16T07:49:56.263 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.263+0000 7f71a72ebec0 1 --2- 172.21.15.121:0/2871895275 >> v2:172.21.15.121:6808/3193900849 conn(0x1049300 0x114cf70 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:56.263 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.263+0000 7f71a72ebec0 1 --2- 172.21.15.121:0/2871895275 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f718403d1c0 0x7f718403f6d0 unknown :-1 s=CLOSED pgs=3816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:56.263 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.263+0000 7f71a72ebec0 1 --2- 172.21.15.121:0/2871895275 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x1040fc0 0x114fad0 unknown :-1 s=CLOSED pgs=12894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:56.263 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.263+0000 7f71a72ebec0 1 -- 172.21.15.121:0/2871895275 >> 172.21.15.121:0/2871895275 conn(0xf6d770 msgr2=0x101cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:49:56.263 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.263+0000 7f71a72ebec0 1 -- 172.21.15.121:0/2871895275 shutdown_connections 2024-09-16T07:49:56.263 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.263+0000 7f71a72ebec0 1 -- 172.21.15.121:0/2871895275 wait complete. 2024-09-16T07:49:56.264 INFO:tasks.workunit.client.0.smithi121.stderr:+ for f in `seq 1 10` 2024-09-16T07:49:56.264 INFO:tasks.workunit.client.0.smithi121.stderr:+ rados -p 989b9542-ea3d-4c5c-8f96-23ff25b76fb1 put obj10 /etc/passwd 2024-09-16T07:49:56.300 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.301+0000 7fa0280e5ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:56.305 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.306+0000 7fa0280e5ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:56.305 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.306+0000 7fa0280e5ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:56.306 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.307+0000 7fa0280e5ec0 1 Processor -- start 2024-09-16T07:49:56.306 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.307+0000 7fa0280e5ec0 1 -- start start 2024-09-16T07:49:56.307 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.308+0000 7fa0280e5ec0 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xae3e30 0xc026c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:49:56.307 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.308+0000 7fa0280e5ec0 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0xa4e520 con 0xae3e30 2024-09-16T07:49:56.308 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.308+0000 7fa01b7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xae3e30 0xc026c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:49:56.308 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.308+0000 7fa01b7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xae3e30 0xc026c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44422/0 (socket says 172.21.15.121:44422) 2024-09-16T07:49:56.308 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.308+0000 7fa01b7fe640 1 -- 172.21.15.121:0/3774105961 learned_addr learned my addr 172.21.15.121:0/3774105961 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:49:56.308 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.308+0000 7fa01b7fe640 1 -- 172.21.15.121:0/3774105961 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x9eae10 con 0xae3e30 2024-09-16T07:49:56.308 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.309+0000 7fa01b7fe640 1 --2- 172.21.15.121:0/3774105961 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xae3e30 0xc026c0 crc :-1 s=READY pgs=12897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=827c7a806aad3a63 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:49:56.308 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.309+0000 7fa01a7fc640 1 -- 172.21.15.121:0/3774105961 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa00c00b500 con 0xae3e30 2024-09-16T07:49:56.308 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.309+0000 7fa01a7fc640 1 -- 172.21.15.121:0/3774105961 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa00c00b660 con 0xae3e30 2024-09-16T07:49:56.308 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.309+0000 7fa01a7fc640 1 -- 172.21.15.121:0/3774105961 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa00c00b900 con 0xae3e30 2024-09-16T07:49:56.309 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.309+0000 7fa0280e5ec0 1 -- 172.21.15.121:0/3774105961 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xae3e30 msgr2=0xc026c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:49:56.309 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.309+0000 7fa0280e5ec0 1 --2- 172.21.15.121:0/3774105961 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xae3e30 0xc026c0 crc :-1 s=READY pgs=12897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:56.309 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.309+0000 7fa0280e5ec0 1 -- 172.21.15.121:0/3774105961 shutdown_connections 2024-09-16T07:49:56.309 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.309+0000 7fa0280e5ec0 1 --2- 172.21.15.121:0/3774105961 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xae3e30 0xc026c0 unknown :-1 s=CLOSED pgs=12897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:56.309 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.309+0000 7fa0280e5ec0 1 -- 172.21.15.121:0/3774105961 >> 172.21.15.121:0/3774105961 conn(0xa0e770 msgr2=0xaec370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:49:56.310 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.309+0000 7fa0280e5ec0 1 -- 172.21.15.121:0/3774105961 shutdown_connections 2024-09-16T07:49:56.310 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.309+0000 7fa0280e5ec0 1 -- 172.21.15.121:0/3774105961 wait complete. 2024-09-16T07:49:56.310 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.310+0000 7fa0280e5ec0 1 Processor -- start 2024-09-16T07:49:56.310 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.310+0000 7fa0280e5ec0 1 -- start start 2024-09-16T07:49:56.314 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.311+0000 7fa0280e5ec0 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xae3e30 0xae6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:49:56.314 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.311+0000 7fa0280e5ec0 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0xa4c280 con 0xae3e30 2024-09-16T07:49:56.314 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.311+0000 7fa01b7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xae3e30 0xae6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:49:56.314 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.311+0000 7fa01b7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xae3e30 0xae6060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44426/0 (socket says 172.21.15.121:44426) 2024-09-16T07:49:56.314 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.311+0000 7fa01b7fe640 1 -- 172.21.15.121:0/3371367556 learned_addr learned my addr 172.21.15.121:0/3371367556 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:49:56.314 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.311+0000 7fa01b7fe640 1 -- 172.21.15.121:0/3371367556 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x9dc920 con 0xae3e30 2024-09-16T07:49:56.314 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.312+0000 7fa01b7fe640 1 --2- 172.21.15.121:0/3371367556 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xae3e30 0xae6060 crc :-1 s=READY pgs=12898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:49:56.315 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.312+0000 7fa0197fa640 1 -- 172.21.15.121:0/3371367556 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa00c0111e0 con 0xae3e30 2024-09-16T07:49:56.315 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.312+0000 7fa0197fa640 1 -- 172.21.15.121:0/3371367556 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa00c011830 con 0xae3e30 2024-09-16T07:49:56.315 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.312+0000 7fa0280e5ec0 1 -- 172.21.15.121:0/3371367556 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x9dc380 con 0xae3e30 2024-09-16T07:49:56.315 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.312+0000 7fa0197fa640 1 -- 172.21.15.121:0/3371367556 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa00c0119a0 con 0xae3e30 2024-09-16T07:49:56.315 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.312+0000 7fa0280e5ec0 1 -- 172.21.15.121:0/3371367556 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0xb66080 con 0xae3e30 2024-09-16T07:49:56.315 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.313+0000 7fa0197fa640 1 -- 172.21.15.121:0/3371367556 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fa00c011b50 con 0xae3e30 2024-09-16T07:49:56.316 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.313+0000 7fa0197fa640 1 --2- 172.21.15.121:0/3371367556 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f9ffc03d1c0 0x7f9ffc03f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:49:56.316 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.313+0000 7fa0197fa640 1 -- 172.21.15.121:0/3371367556 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(697..697 src has 620..697) ==== 3819+0+0 (crc 0 0 0) 0x7fa00c0500f0 con 0xae3e30 2024-09-16T07:49:56.316 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.313+0000 7fa0280e5ec0 1 --2- 172.21.15.121:0/3371367556 >> v2:172.21.15.121:6808/3193900849 conn(0xb7cfc0 0xb75710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:49:56.316 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.313+0000 7fa0280e5ec0 1 -- 172.21.15.121:0/3371367556 --> v2:172.21.15.121:6808/3193900849 -- osd_op(unknown.0.0:1 199.b 199:d1337354:::obj10:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e697) -- 0xb65bf0 con 0xb7cfc0 2024-09-16T07:49:56.316 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.313+0000 7fa012ffd640 1 --2- 172.21.15.121:0/3371367556 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f9ffc03d1c0 0x7f9ffc03f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:49:56.316 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.314+0000 7fa020c40640 1 --2- 172.21.15.121:0/3371367556 >> v2:172.21.15.121:6808/3193900849 conn(0xb7cfc0 0xb75710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T07:49:56.317 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.315+0000 7fa012ffd640 1 --2- 172.21.15.121:0/3371367556 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f9ffc03d1c0 0x7f9ffc03f6d0 crc :-1 s=READY pgs=3817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:49:56.317 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.318+0000 7fa020c40640 1 --2- 172.21.15.121:0/3371367556 >> v2:172.21.15.121:6808/3193900849 conn(0xb7cfc0 0xb75710 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:49:56.333 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.334+0000 7fa020c40640 1 -- 172.21.15.121:0/3371367556 <== osd.0 v2:172.21.15.121:6808/3193900849 1 ==== osd_op_reply(1 obj10 [writefull 0~12875] v697'1 uv1 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa01400a430 con 0xb7cfc0 2024-09-16T07:49:56.333 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.334+0000 7fa0280e5ec0 1 -- 172.21.15.121:0/3371367556 >> v2:172.21.15.121:6808/3193900849 conn(0xb7cfc0 msgr2=0xb75710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:49:56.334 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.334+0000 7fa0280e5ec0 1 --2- 172.21.15.121:0/3371367556 >> v2:172.21.15.121:6808/3193900849 conn(0xb7cfc0 0xb75710 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:56.334 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.334+0000 7fa0280e5ec0 1 -- 172.21.15.121:0/3371367556 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f9ffc03d1c0 msgr2=0x7f9ffc03f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:49:56.334 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.334+0000 7fa0280e5ec0 1 --2- 172.21.15.121:0/3371367556 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f9ffc03d1c0 0x7f9ffc03f6d0 crc :-1 s=READY pgs=3817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:56.334 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.334+0000 7fa0280e5ec0 1 -- 172.21.15.121:0/3371367556 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xae3e30 msgr2=0xae6060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:49:56.334 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.334+0000 7fa0280e5ec0 1 --2- 172.21.15.121:0/3371367556 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xae3e30 0xae6060 crc :-1 s=READY pgs=12898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:56.334 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.334+0000 7fa0280e5ec0 1 -- 172.21.15.121:0/3371367556 shutdown_connections 2024-09-16T07:49:56.334 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.334+0000 7fa0280e5ec0 1 --2- 172.21.15.121:0/3371367556 >> v2:172.21.15.121:6808/3193900849 conn(0xb7cfc0 0xb75710 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:56.334 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.334+0000 7fa0280e5ec0 1 --2- 172.21.15.121:0/3371367556 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f9ffc03d1c0 0x7f9ffc03f6d0 unknown :-1 s=CLOSED pgs=3817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:56.334 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.334+0000 7fa0280e5ec0 1 --2- 172.21.15.121:0/3371367556 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xae3e30 0xae6060 unknown :-1 s=CLOSED pgs=12898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:49:56.334 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.334+0000 7fa0280e5ec0 1 -- 172.21.15.121:0/3371367556 >> 172.21.15.121:0/3371367556 conn(0xa0e770 msgr2=0xaec370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:49:56.334 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.334+0000 7fa0280e5ec0 1 -- 172.21.15.121:0/3371367556 shutdown_connections 2024-09-16T07:49:56.334 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:49:56.334+0000 7fa0280e5ec0 1 -- 172.21.15.121:0/3371367556 wait complete. 2024-09-16T07:49:56.335 INFO:tasks.workunit.client.0.smithi121.stderr:+ sleep 30 2024-09-16T07:50:26.338 INFO:tasks.workunit.client.0.smithi121.stderr:+ pid=96098 2024-09-16T07:50:26.339 INFO:tasks.workunit.client.0.smithi121.stderr:+ ceph osd pool set-quota 989b9542-ea3d-4c5c-8f96-23ff25b76fb1 max_objects 100 2024-09-16T07:50:26.339 INFO:tasks.workunit.client.0.smithi121.stderr:+ rados -p 989b9542-ea3d-4c5c-8f96-23ff25b76fb1 put onemore /etc/passwd 2024-09-16T07:50:26.377 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.378+0000 7f367f22cec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:26.383 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.384+0000 7f367f22cec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:26.384 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.385+0000 7f367f22cec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:26.384 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.385+0000 7f367f22cec0 1 Processor -- start 2024-09-16T07:50:26.384 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.385+0000 7f367f22cec0 1 -- start start 2024-09-16T07:50:26.386 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.386+0000 7f367f22cec0 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x2090050 0x21b0540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:50:26.386 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.386+0000 7f367f22cec0 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x1ffd520 con 0x2090050 2024-09-16T07:50:26.386 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.386+0000 7f367739b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x2090050 0x21b0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:50:26.386 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.387+0000 7f367739b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x2090050 0x21b0540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36986/0 (socket says 172.21.15.121:36986) 2024-09-16T07:50:26.386 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.387+0000 7f367739b640 1 -- 172.21.15.121:0/3275825282 learned_addr learned my addr 172.21.15.121:0/3275825282 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:50:26.387 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.387+0000 7f367739b640 1 -- 172.21.15.121:0/3275825282 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1f99e10 con 0x2090050 2024-09-16T07:50:26.387 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.387+0000 7f367739b640 1 --2- 172.21.15.121:0/3275825282 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x2090050 0x21b0540 crc :-1 s=READY pgs=12901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25fb03646d4c12cf server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:50:26.387 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.387+0000 7f3675b98640 1 -- 172.21.15.121:0/3275825282 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f366002dca0 con 0x2090050 2024-09-16T07:50:26.387 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.387+0000 7f3675b98640 1 -- 172.21.15.121:0/3275825282 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f3660037370 con 0x2090050 2024-09-16T07:50:26.387 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.387+0000 7f3675b98640 1 -- 172.21.15.121:0/3275825282 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3660037610 con 0x2090050 2024-09-16T07:50:26.388 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.388+0000 7f367f22cec0 1 -- 172.21.15.121:0/3275825282 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x2090050 msgr2=0x21b0540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:50:26.388 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.388+0000 7f367f22cec0 1 --2- 172.21.15.121:0/3275825282 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x2090050 0x21b0540 crc :-1 s=READY pgs=12901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:50:26.388 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.388+0000 7f367f22cec0 1 -- 172.21.15.121:0/3275825282 shutdown_connections 2024-09-16T07:50:26.388 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.388+0000 7f367f22cec0 1 --2- 172.21.15.121:0/3275825282 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x2090050 0x21b0540 unknown :-1 s=CLOSED pgs=12901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:50:26.388 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.388+0000 7f367f22cec0 1 -- 172.21.15.121:0/3275825282 >> 172.21.15.121:0/3275825282 conn(0x1fbd770 msgr2=0x21b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:50:26.389 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.388+0000 7f367f22cec0 1 -- 172.21.15.121:0/3275825282 shutdown_connections 2024-09-16T07:50:26.389 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.388+0000 7f367f22cec0 1 -- 172.21.15.121:0/3275825282 wait complete. 2024-09-16T07:50:26.389 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.389+0000 7f367f22cec0 1 Processor -- start 2024-09-16T07:50:26.389 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.389+0000 7f367f22cec0 1 -- start start 2024-09-16T07:50:26.391 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.391+0000 7f367f22cec0 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x2090050 0x2094950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:50:26.391 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.391+0000 7f367f22cec0 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x1ffb280 con 0x2090050 2024-09-16T07:50:26.391 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.391+0000 7f367739b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x2090050 0x2094950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:50:26.391 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.391+0000 7f367739b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x2090050 0x2094950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:37002/0 (socket says 172.21.15.121:37002) 2024-09-16T07:50:26.391 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.391+0000 7f367739b640 1 -- 172.21.15.121:0/748584970 learned_addr learned my addr 172.21.15.121:0/748584970 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:50:26.391 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.391+0000 7f367739b640 1 -- 172.21.15.121:0/748584970 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1f8b920 con 0x2090050 2024-09-16T07:50:26.391 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.392+0000 7f367739b640 1 --2- 172.21.15.121:0/748584970 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x2090050 0x2094950 crc :-1 s=READY pgs=12902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:50:26.391 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.392+0000 7f3674b96640 1 -- 172.21.15.121:0/748584970 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f366003f040 con 0x2090050 2024-09-16T07:50:26.391 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.392+0000 7f3674b96640 1 -- 172.21.15.121:0/748584970 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f36600374e0 con 0x2090050 2024-09-16T07:50:26.391 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.392+0000 7f3674b96640 1 -- 172.21.15.121:0/748584970 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f366002dca0 con 0x2090050 2024-09-16T07:50:26.392 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.392+0000 7f367f22cec0 1 -- 172.21.15.121:0/748584970 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1f8b380 con 0x2090050 2024-09-16T07:50:26.392 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.392+0000 7f367f22cec0 1 -- 172.21.15.121:0/748584970 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x21b1250 con 0x2090050 2024-09-16T07:50:26.392 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.393+0000 7f3674b96640 1 -- 172.21.15.121:0/748584970 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f3660039450 con 0x2090050 2024-09-16T07:50:26.393 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.393+0000 7f3674b96640 1 --2- 172.21.15.121:0/748584970 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f365c03d1c0 0x7f365c03f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:50:26.393 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.393+0000 7f3674b96640 1 -- 172.21.15.121:0/748584970 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(698..698 src has 620..698) ==== 3819+0+0 (crc 0 0 0) 0x7f3660032040 con 0x2090050 2024-09-16T07:50:26.393 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.393+0000 7f3674b96640 1 -- 172.21.15.121:0/748584970 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=699}) -- 0x7f365c043450 con 0x2090050 2024-09-16T07:50:26.393 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.393+0000 7f367f22cec0 1 --2- 172.21.15.121:0/748584970 >> v2:172.21.15.172:6804/2274906412 conn(0x21273a0 0x21237c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:50:26.393 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.394+0000 7f3676b9a640 1 --2- 172.21.15.121:0/748584970 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f365c03d1c0 0x7f365c03f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:50:26.394 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.394+0000 7f3676b9a640 1 --2- 172.21.15.121:0/748584970 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f365c03d1c0 0x7f365c03f6d0 crc :-1 s=READY pgs=3818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:50:26.394 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.394+0000 7f3677b9c640 1 --2- 172.21.15.121:0/748584970 >> v2:172.21.15.172:6804/2274906412 conn(0x21273a0 0x21237c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T07:50:26.396 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.397+0000 7f3677b9c640 1 --2- 172.21.15.121:0/748584970 >> v2:172.21.15.172:6804/2274906412 conn(0x21273a0 0x21237c0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:50:26.438 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.430+0000 7fa4abca3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:26.438 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.440+0000 7fa4abca3640 1 Processor -- start 2024-09-16T07:50:26.438 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.440+0000 7fa4abca3640 1 -- start start 2024-09-16T07:50:26.441 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.441+0000 7fa4abca3640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa4a41369d0 0x7fa4a413b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:50:26.441 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.441+0000 7fa4abca3640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4a409fd50 con 0x7fa4a409ed30 2024-09-16T07:50:26.441 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.441+0000 7fa4abca3640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fa4a409fa40 con 0x7fa4a41369d0 2024-09-16T07:50:26.441 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.441+0000 7fa4a923e640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa4a41369d0 0x7fa4a413b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:50:26.441 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.441+0000 7fa4a923e640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa4a41369d0 0x7fa4a413b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:37016/0 (socket says 172.21.15.121:37016) 2024-09-16T07:50:26.441 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.441+0000 7fa4a923e640 1 -- 172.21.15.121:0/1424830662 learned_addr learned my addr 172.21.15.121:0/1424830662 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:50:26.441 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.441+0000 7fa4a9a3f640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fa4a409ed30 0x7fa4a41362c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:42514/0 (socket says 172.21.15.121:42514) 2024-09-16T07:50:26.441 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.441+0000 7fa4a923e640 1 -- 172.21.15.121:0/1424830662 >> v1:172.21.15.121:6789/0 conn(0x7fa4a409ed30 legacy=0x7fa4a41362c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:50:26.442 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.441+0000 7fa4a923e640 1 -- 172.21.15.121:0/1424830662 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4a409ffe0 con 0x7fa4a41369d0 2024-09-16T07:50:26.442 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.441+0000 7fa4a8a3d640 1 -- 172.21.15.121:0/1424830662 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2292359423 0 0) 0x7fa4a409fd50 con 0x7fa4a409ed30 2024-09-16T07:50:26.442 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.441+0000 7fa4a923e640 1 --2- 172.21.15.121:0/1424830662 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4a41369d0 0x7fa4a413b0b0 crc :-1 s=READY pgs=12904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=715ec13cc247cf2b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:50:26.442 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.442+0000 7fa4a8a3d640 1 -- 172.21.15.121:0/1424830662 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa49800e040 con 0x7fa4a41369d0 2024-09-16T07:50:26.442 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.442+0000 7fa4a8a3d640 1 -- 172.21.15.121:0/1424830662 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa4980091e0 con 0x7fa4a41369d0 2024-09-16T07:50:26.442 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.442+0000 7fa4a8a3d640 1 -- 172.21.15.121:0/1424830662 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa498007730 con 0x7fa4a41369d0 2024-09-16T07:50:26.443 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.442+0000 7fa4abca3640 1 -- 172.21.15.121:0/1424830662 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4a41369d0 msgr2=0x7fa4a413b0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:50:26.443 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.442+0000 7fa4abca3640 1 --2- 172.21.15.121:0/1424830662 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4a41369d0 0x7fa4a413b0b0 crc :-1 s=READY pgs=12904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:50:26.443 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.442+0000 7fa4abca3640 1 -- 172.21.15.121:0/1424830662 shutdown_connections 2024-09-16T07:50:26.443 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.442+0000 7fa4abca3640 1 --2- 172.21.15.121:0/1424830662 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4a41369d0 0x7fa4a413b0b0 unknown :-1 s=CLOSED pgs=12904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:50:26.443 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.442+0000 7fa4abca3640 1 -- 172.21.15.121:0/1424830662 >> 172.21.15.121:0/1424830662 conn(0x7fa4a40a5350 msgr2=0x7fa4a40a5760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:50:26.444 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.443+0000 7fa4abca3640 1 -- 172.21.15.121:0/1424830662 shutdown_connections 2024-09-16T07:50:26.444 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.443+0000 7fa4abca3640 1 -- 172.21.15.121:0/1424830662 wait complete. 2024-09-16T07:50:26.444 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.443+0000 7fa4abca3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:26.444 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.444+0000 7fa4abca3640 1 Processor -- start 2024-09-16T07:50:26.444 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.444+0000 7fa4abca3640 1 -- start start 2024-09-16T07:50:26.445 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.445+0000 7fa4abca3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4a409ed30 0x7fa4a4124110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:50:26.446 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.445+0000 7fa4abca3640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa4a4120b60 con 0x7fa4a409ed30 2024-09-16T07:50:26.446 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.445+0000 7fa4a9a3f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4a409ed30 0x7fa4a4124110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:50:26.446 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.445+0000 7fa4a9a3f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4a409ed30 0x7fa4a4124110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:37028/0 (socket says 172.21.15.121:37028) 2024-09-16T07:50:26.446 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.445+0000 7fa4a9a3f640 1 -- 172.21.15.121:0/1981401224 learned_addr learned my addr 172.21.15.121:0/1981401224 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:50:26.446 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.446+0000 7fa4a9a3f640 1 -- 172.21.15.121:0/1981401224 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4a41222d0 con 0x7fa4a409ed30 2024-09-16T07:50:26.446 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.446+0000 7fa4a9a3f640 1 --2- 172.21.15.121:0/1981401224 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4a409ed30 0x7fa4a4124110 crc :-1 s=READY pgs=12905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:50:26.446 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.446+0000 7fa4a27fc640 1 -- 172.21.15.121:0/1981401224 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa494004b80 con 0x7fa4a409ed30 2024-09-16T07:50:26.446 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.446+0000 7fa4a27fc640 1 -- 172.21.15.121:0/1981401224 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa494004ce0 con 0x7fa4a409ed30 2024-09-16T07:50:26.446 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.446+0000 7fa4abca3640 1 -- 172.21.15.121:0/1981401224 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4a4120850 con 0x7fa4a409ed30 2024-09-16T07:50:26.446 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.446+0000 7fa4a27fc640 1 -- 172.21.15.121:0/1981401224 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa494007120 con 0x7fa4a409ed30 2024-09-16T07:50:26.446 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.446+0000 7fa4abca3640 1 -- 172.21.15.121:0/1981401224 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4a4123130 con 0x7fa4a409ed30 2024-09-16T07:50:26.447 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.447+0000 7fa4abca3640 1 -- 172.21.15.121:0/1981401224 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4a41362c0 con 0x7fa4a409ed30 2024-09-16T07:50:26.447 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.447+0000 7fa4a27fc640 1 -- 172.21.15.121:0/1981401224 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fa4940072d0 con 0x7fa4a409ed30 2024-09-16T07:50:26.448 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.447+0000 7fa4a27fc640 1 --2- 172.21.15.121:0/1981401224 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fa49003e960 0x7fa490040e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:50:26.448 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.447+0000 7fa4a27fc640 1 -- 172.21.15.121:0/1981401224 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(698..698 src has 620..698) ==== 3819+0+0 (crc 0 0 0) 0x7fa49404fcc0 con 0x7fa4a409ed30 2024-09-16T07:50:26.448 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.447+0000 7fa4a27fc640 1 -- 172.21.15.121:0/1981401224 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=699}) -- 0x7fa490044c50 con 0x7fa4a409ed30 2024-09-16T07:50:26.448 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.448+0000 7fa4a923e640 1 --2- 172.21.15.121:0/1981401224 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fa49003e960 0x7fa490040e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:50:26.448 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.448+0000 7fa4a923e640 1 --2- 172.21.15.121:0/1981401224 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fa49003e960 0x7fa490040e70 crc :-1 s=READY pgs=3819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:50:26.451 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.452+0000 7fa4a27fc640 1 -- 172.21.15.121:0/1981401224 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fa49400f420 con 0x7fa4a409ed30 2024-09-16T07:50:26.628 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:26.629+0000 7fa4abca3640 1 -- 172.21.15.121:0/1981401224 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "989b9542-ea3d-4c5c-8f96-23ff25b76fb1", "field": "max_objects", "val": "100"} v 0) -- 0x7fa4a4076080 con 0x7fa4a409ed30 2024-09-16T07:50:27.476 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:27.477+0000 7fa4a27fc640 1 -- 172.21.15.121:0/1981401224 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "989b9542-ea3d-4c5c-8f96-23ff25b76fb1", "field": "max_objects", "val": "100"}]=0 set-quota max_objects = 100 for pool 989b9542-ea3d-4c5c-8f96-23ff25b76fb1 v699) ==== 225+0+0 (crc 0 0 0) 0x7fa4940067b0 con 0x7fa4a409ed30 2024-09-16T07:50:27.479 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:27.480+0000 7fa4a27fc640 1 -- 172.21.15.121:0/1981401224 <== mon.0 v2:172.21.15.121:3300/0 8 ==== osd_map(699..699 src has 620..699) ==== 628+0+0 (crc 0 0 0) 0x7fa4940060b0 con 0x7fa4a409ed30 2024-09-16T07:50:27.479 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:27.480+0000 7fa4a27fc640 1 -- 172.21.15.121:0/1981401224 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=700}) -- 0x7fa490045bd0 con 0x7fa4a409ed30 2024-09-16T07:50:27.479 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:27.480+0000 7f3674b96640 1 -- 172.21.15.121:0/748584970 <== mon.0 v2:172.21.15.121:3300/0 6 ==== osd_map(699..699 src has 620..699) ==== 628+0+0 (crc 0 0 0) 0x7f366003d0c0 con 0x2090050 2024-09-16T07:50:27.479 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:27.480+0000 7f3674b96640 1 -- 172.21.15.121:0/748584970 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=700}) -- 0x7f365c043b90 con 0x2090050 2024-09-16T07:50:27.601 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:27.602+0000 7fa4abca3640 1 -- 172.21.15.121:0/1981401224 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "989b9542-ea3d-4c5c-8f96-23ff25b76fb1", "field": "max_objects", "val": "100"} v 0) -- 0x7fa4a41369a0 con 0x7fa4a409ed30 2024-09-16T07:50:28.554 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:28.554+0000 7fa4a27fc640 1 -- 172.21.15.121:0/1981401224 <== mon.0 v2:172.21.15.121:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "989b9542-ea3d-4c5c-8f96-23ff25b76fb1", "field": "max_objects", "val": "100"}]=0 set-quota max_objects = 100 for pool 989b9542-ea3d-4c5c-8f96-23ff25b76fb1 v700) ==== 225+0+0 (crc 0 0 0) 0x7fa49400a0c0 con 0x7fa4a409ed30 2024-09-16T07:50:28.554 INFO:tasks.workunit.client.0.smithi121.stderr:set-quota max_objects = 100 for pool 989b9542-ea3d-4c5c-8f96-23ff25b76fb1 2024-09-16T07:50:28.554 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:28.554+0000 7fa4a27fc640 1 -- 172.21.15.121:0/1981401224 <== mon.0 v2:172.21.15.121:3300/0 10 ==== osd_map(700..700 src has 620..700) ==== 628+0+0 (crc 0 0 0) 0x7fa49400cdc0 con 0x7fa4a409ed30 2024-09-16T07:50:28.554 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:28.555+0000 7fa4a27fc640 1 -- 172.21.15.121:0/1981401224 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=701}) -- 0x7fa490045e10 con 0x7fa4a409ed30 2024-09-16T07:50:28.554 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:28.555+0000 7f3674b96640 1 -- 172.21.15.121:0/748584970 <== mon.0 v2:172.21.15.121:3300/0 7 ==== osd_map(700..700 src has 620..700) ==== 628+0+0 (crc 0 0 0) 0x7f3660034a20 con 0x2090050 2024-09-16T07:50:28.554 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:28.555+0000 7f3674b96640 1 -- 172.21.15.121:0/748584970 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=701}) -- 0x7f365c043db0 con 0x2090050 2024-09-16T07:50:28.558 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:28.558+0000 7fa4abca3640 1 -- 172.21.15.121:0/1981401224 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fa49003e960 msgr2=0x7fa490040e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:50:28.558 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:28.558+0000 7fa4abca3640 1 --2- 172.21.15.121:0/1981401224 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fa49003e960 0x7fa490040e70 crc :-1 s=READY pgs=3819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:50:28.558 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:28.558+0000 7fa4abca3640 1 -- 172.21.15.121:0/1981401224 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4a409ed30 msgr2=0x7fa4a4124110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:50:28.558 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:28.558+0000 7fa4abca3640 1 --2- 172.21.15.121:0/1981401224 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4a409ed30 0x7fa4a4124110 crc :-1 s=READY pgs=12905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:50:28.558 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:28.559+0000 7fa4abca3640 1 -- 172.21.15.121:0/1981401224 shutdown_connections 2024-09-16T07:50:28.558 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:28.559+0000 7fa4abca3640 1 --2- 172.21.15.121:0/1981401224 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fa49003e960 0x7fa490040e70 unknown :-1 s=CLOSED pgs=3819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:50:28.558 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:28.559+0000 7fa4abca3640 1 --2- 172.21.15.121:0/1981401224 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4a409ed30 0x7fa4a4124110 crc :-1 s=CLOSED pgs=12905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:50:28.558 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:28.559+0000 7fa4abca3640 1 -- 172.21.15.121:0/1981401224 >> 172.21.15.121:0/1981401224 conn(0x7fa4a40a5350 msgr2=0x7fa4a40a3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:50:28.558 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:28.559+0000 7fa4abca3640 1 -- 172.21.15.121:0/1981401224 shutdown_connections 2024-09-16T07:50:28.558 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:28.559+0000 7fa4abca3640 1 -- 172.21.15.121:0/1981401224 wait complete. 2024-09-16T07:50:28.572 INFO:tasks.workunit.client.0.smithi121.stderr:+ wait 96098 2024-09-16T07:50:31.392 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:31.393+0000 7f3678dfe640 1 -- 172.21.15.121:0/748584970 --> v2:172.21.15.172:6804/2274906412 -- ping magic: 0 -- 0x7f3648000b90 con 0x21273a0 2024-09-16T07:50:32.478 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.479+0000 7f3674b96640 1 -- 172.21.15.121:0/748584970 <== mon.0 v2:172.21.15.121:3300/0 8 ==== osd_map(701..701 src has 620..701) ==== 628+0+0 (crc 0 0 0) 0x7f3660040210 con 0x2090050 2024-09-16T07:50:32.479 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.479+0000 7f3674b96640 1 -- 172.21.15.121:0/748584970 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=702}) -- 0x7f365c043db0 con 0x2090050 2024-09-16T07:50:32.479 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.480+0000 7f3674b96640 1 -- 172.21.15.121:0/748584970 --> v2:172.21.15.172:6804/2274906412 -- osd_op(unknown.0.0:1 199.5 199:b9ff7440:::onemore:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e701) -- 0x7f365c044030 con 0x21273a0 2024-09-16T07:50:32.526 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.526+0000 7f3677b9c640 1 -- 172.21.15.121:0/748584970 <== osd.2 v2:172.21.15.172:6804/2274906412 1 ==== osd_op_reply(1 onemore [writefull 0~12875] v701'2 uv2 ondisk = 0) ==== 151+0+0 (crc 0 0 0) 0x7f366800a430 con 0x21273a0 2024-09-16T07:50:32.526 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.527+0000 7f367f22cec0 1 -- 172.21.15.121:0/748584970 >> v2:172.21.15.172:6804/2274906412 conn(0x21273a0 msgr2=0x21237c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:50:32.526 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.527+0000 7f367f22cec0 1 --2- 172.21.15.121:0/748584970 >> v2:172.21.15.172:6804/2274906412 conn(0x21273a0 0x21237c0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:50:32.526 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.527+0000 7f367f22cec0 1 -- 172.21.15.121:0/748584970 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f365c03d1c0 msgr2=0x7f365c03f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:50:32.527 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.527+0000 7f367f22cec0 1 --2- 172.21.15.121:0/748584970 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f365c03d1c0 0x7f365c03f6d0 crc :-1 s=READY pgs=3818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:50:32.527 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.527+0000 7f367f22cec0 1 -- 172.21.15.121:0/748584970 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x2090050 msgr2=0x2094950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:50:32.527 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.527+0000 7f367f22cec0 1 --2- 172.21.15.121:0/748584970 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x2090050 0x2094950 crc :-1 s=READY pgs=12902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:50:32.527 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.527+0000 7f367f22cec0 1 -- 172.21.15.121:0/748584970 shutdown_connections 2024-09-16T07:50:32.527 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.527+0000 7f367f22cec0 1 --2- 172.21.15.121:0/748584970 >> v2:172.21.15.172:6804/2274906412 conn(0x21273a0 0x21237c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:50:32.527 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.527+0000 7f367f22cec0 1 --2- 172.21.15.121:0/748584970 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f365c03d1c0 0x7f365c03f6d0 unknown :-1 s=CLOSED pgs=3818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:50:32.527 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.527+0000 7f367f22cec0 1 --2- 172.21.15.121:0/748584970 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x2090050 0x2094950 unknown :-1 s=CLOSED pgs=12902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:50:32.527 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.527+0000 7f367f22cec0 1 -- 172.21.15.121:0/748584970 >> 172.21.15.121:0/748584970 conn(0x1fbd770 msgr2=0x209b370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:50:32.527 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.527+0000 7f367f22cec0 1 -- 172.21.15.121:0/748584970 shutdown_connections 2024-09-16T07:50:32.527 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.527+0000 7f367f22cec0 1 -- 172.21.15.121:0/748584970 wait complete. 2024-09-16T07:50:32.528 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' 0 -ne 0 ']' 2024-09-16T07:50:32.528 INFO:tasks.workunit.client.0.smithi121.stderr:+ true 2024-09-16T07:50:32.528 INFO:tasks.workunit.client.0.smithi121.stderr:+ rados -p 989b9542-ea3d-4c5c-8f96-23ff25b76fb1 put twomore /etc/passwd 2024-09-16T07:50:32.566 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.567+0000 7f7fffc2fec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:32.570 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.572+0000 7f7fffc2fec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:32.571 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.572+0000 7f7fffc2fec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:32.571 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.572+0000 7f7fffc2fec0 1 Processor -- start 2024-09-16T07:50:32.571 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.573+0000 7f7fffc2fec0 1 -- start start 2024-09-16T07:50:32.573 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.573+0000 7f7fffc2fec0 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xe72e30 0xf916c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:50:32.573 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.573+0000 7f7fffc2fec0 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0xddd520 con 0xe72e30 2024-09-16T07:50:32.573 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.574+0000 7f7ff2ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xe72e30 0xf916c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:50:32.573 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.574+0000 7f7ff2ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xe72e30 0xf916c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:37044/0 (socket says 172.21.15.121:37044) 2024-09-16T07:50:32.573 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.574+0000 7f7ff2ffd640 1 -- 172.21.15.121:0/3765453067 learned_addr learned my addr 172.21.15.121:0/3765453067 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:50:32.573 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.574+0000 7f7ff2ffd640 1 -- 172.21.15.121:0/3765453067 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xd79e10 con 0xe72e30 2024-09-16T07:50:32.573 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.574+0000 7f7ff2ffd640 1 --2- 172.21.15.121:0/3765453067 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xe72e30 0xf916c0 crc :-1 s=READY pgs=12908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c7839856031a899 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:50:32.573 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.574+0000 7f7ff1ffb640 1 -- 172.21.15.121:0/3765453067 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7fe402dcc0 con 0xe72e30 2024-09-16T07:50:32.573 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.574+0000 7f7ff1ffb640 1 -- 172.21.15.121:0/3765453067 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f7fe4037370 con 0xe72e30 2024-09-16T07:50:32.573 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.574+0000 7f7ff1ffb640 1 -- 172.21.15.121:0/3765453067 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7fe4037610 con 0xe72e30 2024-09-16T07:50:32.578 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.575+0000 7f7fffc2fec0 1 -- 172.21.15.121:0/3765453067 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xe72e30 msgr2=0xf916c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:50:32.578 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.575+0000 7f7fffc2fec0 1 --2- 172.21.15.121:0/3765453067 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xe72e30 0xf916c0 crc :-1 s=READY pgs=12908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:50:32.578 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.575+0000 7f7fffc2fec0 1 -- 172.21.15.121:0/3765453067 shutdown_connections 2024-09-16T07:50:32.578 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.575+0000 7f7fffc2fec0 1 --2- 172.21.15.121:0/3765453067 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xe72e30 0xf916c0 unknown :-1 s=CLOSED pgs=12908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:50:32.578 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.575+0000 7f7fffc2fec0 1 -- 172.21.15.121:0/3765453067 >> 172.21.15.121:0/3765453067 conn(0xd9d770 msgr2=0xf947d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:50:32.578 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.575+0000 7f7fffc2fec0 1 -- 172.21.15.121:0/3765453067 shutdown_connections 2024-09-16T07:50:32.578 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.575+0000 7f7fffc2fec0 1 -- 172.21.15.121:0/3765453067 wait complete. 2024-09-16T07:50:32.578 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.575+0000 7f7fffc2fec0 1 Processor -- start 2024-09-16T07:50:32.578 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.576+0000 7f7fffc2fec0 1 -- start start 2024-09-16T07:50:32.578 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.576+0000 7f7fffc2fec0 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xe72e30 0xe74ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:50:32.579 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.577+0000 7f7fffc2fec0 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0xddb280 con 0xe72e30 2024-09-16T07:50:32.579 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.577+0000 7f7ff2ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xe72e30 0xe74ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:50:32.579 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.577+0000 7f7ff2ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xe72e30 0xe74ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:37048/0 (socket says 172.21.15.121:37048) 2024-09-16T07:50:32.579 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.577+0000 7f7ff2ffd640 1 -- 172.21.15.121:0/2403595081 learned_addr learned my addr 172.21.15.121:0/2403595081 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:50:32.579 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.577+0000 7f7ff2ffd640 1 -- 172.21.15.121:0/2403595081 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xd6b920 con 0xe72e30 2024-09-16T07:50:32.579 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.577+0000 7f7ff2ffd640 1 --2- 172.21.15.121:0/2403595081 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xe72e30 0xe74ea0 crc :-1 s=READY pgs=12909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:50:32.579 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.577+0000 7f7ff0ff9640 1 -- 172.21.15.121:0/2403595081 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7fe403e040 con 0xe72e30 2024-09-16T07:50:32.579 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.577+0000 7f7ff0ff9640 1 -- 172.21.15.121:0/2403595081 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f7fe40374e0 con 0xe72e30 2024-09-16T07:50:32.579 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.577+0000 7f7ff0ff9640 1 -- 172.21.15.121:0/2403595081 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7fe402dcc0 con 0xe72e30 2024-09-16T07:50:32.579 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.577+0000 7f7fffc2fec0 1 -- 172.21.15.121:0/2403595081 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0xd6b380 con 0xe72e30 2024-09-16T07:50:32.579 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.577+0000 7f7fffc2fec0 1 -- 172.21.15.121:0/2403595081 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0xe767c0 con 0xe72e30 2024-09-16T07:50:32.579 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.578+0000 7f7ff0ff9640 1 -- 172.21.15.121:0/2403595081 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f7fe4041040 con 0xe72e30 2024-09-16T07:50:32.579 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.578+0000 7f7ff0ff9640 1 --2- 172.21.15.121:0/2403595081 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f7fd403d1c0 0x7f7fd403f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:50:32.579 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.579+0000 7f7ff0ff9640 1 -- 172.21.15.121:0/2403595081 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(701..701 src has 620..701) ==== 3819+0+0 (crc 0 0 0) 0x7f7fe4032040 con 0xe72e30 2024-09-16T07:50:32.580 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.579+0000 7f7fffc2fec0 1 --2- 172.21.15.121:0/2403595081 >> v2:172.21.15.172:6808/3418488586 conn(0xf0bdf0 0xf04630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:50:32.580 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.579+0000 7f7fffc2fec0 1 -- 172.21.15.121:0/2403595081 --> v2:172.21.15.172:6808/3418488586 -- osd_op(unknown.0.0:1 199.6 199:7019d845:::twomore:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e701) -- 0xef4b80 con 0xf0bdf0 2024-09-16T07:50:32.580 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.579+0000 7f7febfff640 1 --2- 172.21.15.121:0/2403595081 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f7fd403d1c0 0x7f7fd403f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:50:32.580 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.579+0000 7f7febfff640 1 --2- 172.21.15.121:0/2403595081 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f7fd403d1c0 0x7f7fd403f6d0 crc :-1 s=READY pgs=3820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:50:32.580 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.580+0000 7f7ff37fe640 1 --2- 172.21.15.121:0/2403595081 >> v2:172.21.15.172:6808/3418488586 conn(0xf0bdf0 0xf04630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T07:50:32.583 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.584+0000 7f7ff37fe640 1 --2- 172.21.15.121:0/2403595081 >> v2:172.21.15.172:6808/3418488586 conn(0xf0bdf0 0xf04630 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:50:32.600 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.600+0000 7f7ff37fe640 1 -- 172.21.15.121:0/2403595081 <== osd.3 v2:172.21.15.172:6808/3418488586 1 ==== osd_op_reply(1 twomore [writefull 0~12875] v701'1 uv1 ondisk = 0) ==== 151+0+0 (crc 0 0 0) 0x7f7fec00a430 con 0xf0bdf0 2024-09-16T07:50:32.600 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.600+0000 7f7fffc2fec0 1 -- 172.21.15.121:0/2403595081 >> v2:172.21.15.172:6808/3418488586 conn(0xf0bdf0 msgr2=0xf04630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:50:32.600 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.600+0000 7f7fffc2fec0 1 --2- 172.21.15.121:0/2403595081 >> v2:172.21.15.172:6808/3418488586 conn(0xf0bdf0 0xf04630 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:50:32.600 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.601+0000 7f7fffc2fec0 1 -- 172.21.15.121:0/2403595081 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f7fd403d1c0 msgr2=0x7f7fd403f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:50:32.601 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.601+0000 7f7fffc2fec0 1 --2- 172.21.15.121:0/2403595081 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f7fd403d1c0 0x7f7fd403f6d0 crc :-1 s=READY pgs=3820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:50:32.601 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.601+0000 7f7fffc2fec0 1 -- 172.21.15.121:0/2403595081 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xe72e30 msgr2=0xe74ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:50:32.601 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.601+0000 7f7fffc2fec0 1 --2- 172.21.15.121:0/2403595081 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xe72e30 0xe74ea0 crc :-1 s=READY pgs=12909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:50:32.601 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.601+0000 7f7fffc2fec0 1 -- 172.21.15.121:0/2403595081 shutdown_connections 2024-09-16T07:50:32.601 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.601+0000 7f7fffc2fec0 1 --2- 172.21.15.121:0/2403595081 >> v2:172.21.15.172:6808/3418488586 conn(0xf0bdf0 0xf04630 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:50:32.601 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.601+0000 7f7fffc2fec0 1 --2- 172.21.15.121:0/2403595081 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f7fd403d1c0 0x7f7fd403f6d0 unknown :-1 s=CLOSED pgs=3820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:50:32.601 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.601+0000 7f7fffc2fec0 1 --2- 172.21.15.121:0/2403595081 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xe72e30 0xe74ea0 unknown :-1 s=CLOSED pgs=12909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:50:32.601 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.601+0000 7f7fffc2fec0 1 -- 172.21.15.121:0/2403595081 >> 172.21.15.121:0/2403595081 conn(0xd9d770 msgr2=0xf94580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:50:32.601 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.601+0000 7f7fffc2fec0 1 -- 172.21.15.121:0/2403595081 shutdown_connections 2024-09-16T07:50:32.602 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.601+0000 7f7fffc2fec0 1 -- 172.21.15.121:0/2403595081 wait complete. 2024-09-16T07:50:32.602 INFO:tasks.workunit.client.0.smithi121.stderr:+ ceph osd pool set-quota 989b9542-ea3d-4c5c-8f96-23ff25b76fb1 max_bytes 100 2024-09-16T07:50:32.710 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.702+0000 7f0adcd51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:32.711 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.712+0000 7f0adcd51640 1 Processor -- start 2024-09-16T07:50:32.711 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.712+0000 7f0adcd51640 1 -- start start 2024-09-16T07:50:32.713 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.714+0000 7f0adcd51640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f0ad81369d0 0x7f0ad813b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:50:32.713 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.714+0000 7f0adcd51640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ad809fd50 con 0x7f0ad809ed30 2024-09-16T07:50:32.713 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.714+0000 7f0adcd51640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f0ad809fa40 con 0x7f0ad81369d0 2024-09-16T07:50:32.714 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.714+0000 7f0ad5d9b640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f0ad81369d0 0x7f0ad813b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:50:32.714 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.714+0000 7f0ad5d9b640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f0ad81369d0 0x7f0ad813b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:37050/0 (socket says 172.21.15.121:37050) 2024-09-16T07:50:32.714 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.714+0000 7f0ad5d9b640 1 -- 172.21.15.121:0/586955885 learned_addr learned my addr 172.21.15.121:0/586955885 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:50:32.714 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.714+0000 7f0ad5d9b640 1 -- 172.21.15.121:0/586955885 >> v1:172.21.15.121:6789/0 conn(0x7f0ad809ed30 legacy=0x7f0ad81362c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:50:32.714 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.714+0000 7f0ad5d9b640 1 -- 172.21.15.121:0/586955885 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ad809ffe0 con 0x7f0ad81369d0 2024-09-16T07:50:32.714 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.714+0000 7f0ad559a640 1 -- 172.21.15.121:0/586955885 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3636511127 0 0) 0x7f0ad809fd50 con 0x7f0ad809ed30 2024-09-16T07:50:32.714 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.714+0000 7f0ad5d9b640 1 --2- 172.21.15.121:0/586955885 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ad81369d0 0x7f0ad813b0b0 crc :-1 s=READY pgs=12911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e0051c7f5f2b4e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:50:32.714 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.715+0000 7f0ad559a640 1 -- 172.21.15.121:0/586955885 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0ac0009e50 con 0x7f0ad81369d0 2024-09-16T07:50:32.714 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.715+0000 7f0ad559a640 1 -- 172.21.15.121:0/586955885 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0ac000e230 con 0x7f0ad81369d0 2024-09-16T07:50:32.714 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.715+0000 7f0ad559a640 1 -- 172.21.15.121:0/586955885 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0ac000e4d0 con 0x7f0ad81369d0 2024-09-16T07:50:32.715 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.715+0000 7f0adcd51640 1 -- 172.21.15.121:0/586955885 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ad81369d0 msgr2=0x7f0ad813b0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:50:32.715 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.715+0000 7f0adcd51640 1 --2- 172.21.15.121:0/586955885 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ad81369d0 0x7f0ad813b0b0 crc :-1 s=READY pgs=12911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:50:32.715 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.716+0000 7f0adcd51640 1 -- 172.21.15.121:0/586955885 shutdown_connections 2024-09-16T07:50:32.715 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.716+0000 7f0adcd51640 1 --2- 172.21.15.121:0/586955885 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ad81369d0 0x7f0ad813b0b0 unknown :-1 s=CLOSED pgs=12911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:50:32.715 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.716+0000 7f0adcd51640 1 -- 172.21.15.121:0/586955885 >> 172.21.15.121:0/586955885 conn(0x7f0ad80a5350 msgr2=0x7f0ad80a5760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:50:32.715 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.716+0000 7f0adcd51640 1 -- 172.21.15.121:0/586955885 shutdown_connections 2024-09-16T07:50:32.716 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.716+0000 7f0adcd51640 1 -- 172.21.15.121:0/586955885 wait complete. 2024-09-16T07:50:32.716 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.716+0000 7f0adcd51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:32.716 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.718+0000 7f0adcd51640 1 Processor -- start 2024-09-16T07:50:32.716 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.718+0000 7f0adcd51640 1 -- start start 2024-09-16T07:50:32.718 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.719+0000 7f0adcd51640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ad809ed30 0x7f0ad8124110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:50:32.718 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.719+0000 7f0adcd51640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0ad8120b60 con 0x7f0ad809ed30 2024-09-16T07:50:32.719 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.719+0000 7f0ad659c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ad809ed30 0x7f0ad8124110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:50:32.719 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.719+0000 7f0ad659c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ad809ed30 0x7f0ad8124110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:37064/0 (socket says 172.21.15.121:37064) 2024-09-16T07:50:32.719 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.719+0000 7f0ad659c640 1 -- 172.21.15.121:0/570406098 learned_addr learned my addr 172.21.15.121:0/570406098 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:50:32.719 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.719+0000 7f0ad659c640 1 -- 172.21.15.121:0/570406098 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ad81222d0 con 0x7f0ad809ed30 2024-09-16T07:50:32.719 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.719+0000 7f0ad659c640 1 --2- 172.21.15.121:0/570406098 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ad809ed30 0x7f0ad8124110 crc :-1 s=READY pgs=12912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:50:32.719 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.719+0000 7f0aceffd640 1 -- 172.21.15.121:0/570406098 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0ac80051e0 con 0x7f0ad809ed30 2024-09-16T07:50:32.719 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.719+0000 7f0aceffd640 1 -- 172.21.15.121:0/570406098 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0ac8005340 con 0x7f0ad809ed30 2024-09-16T07:50:32.719 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.719+0000 7f0adcd51640 1 -- 172.21.15.121:0/570406098 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ad8120850 con 0x7f0ad809ed30 2024-09-16T07:50:32.719 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.720+0000 7f0aceffd640 1 -- 172.21.15.121:0/570406098 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0ac800c700 con 0x7f0ad809ed30 2024-09-16T07:50:32.719 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.720+0000 7f0adcd51640 1 -- 172.21.15.121:0/570406098 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ad8123130 con 0x7f0ad809ed30 2024-09-16T07:50:32.720 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.721+0000 7f0adcd51640 1 -- 172.21.15.121:0/570406098 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ad81362c0 con 0x7f0ad809ed30 2024-09-16T07:50:32.720 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.721+0000 7f0aceffd640 1 -- 172.21.15.121:0/570406098 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f0ac800c900 con 0x7f0ad809ed30 2024-09-16T07:50:32.720 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.721+0000 7f0aceffd640 1 --2- 172.21.15.121:0/570406098 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f0ab803e910 0x7f0ab8040e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:50:32.720 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.721+0000 7f0aceffd640 1 -- 172.21.15.121:0/570406098 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(701..701 src has 620..701) ==== 3819+0+0 (crc 0 0 0) 0x7f0ac804fbc0 con 0x7f0ad809ed30 2024-09-16T07:50:32.720 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.721+0000 7f0ad5d9b640 1 --2- 172.21.15.121:0/570406098 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f0ab803e910 0x7f0ab8040e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:50:32.721 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.722+0000 7f0ad5d9b640 1 --2- 172.21.15.121:0/570406098 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f0ab803e910 0x7f0ab8040e20 crc :-1 s=READY pgs=3821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:50:32.725 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.726+0000 7f0aceffd640 1 -- 172.21.15.121:0/570406098 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f0ac800dc10 con 0x7f0ad809ed30 2024-09-16T07:50:32.903 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:32.905+0000 7f0adcd51640 1 -- 172.21.15.121:0/570406098 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "989b9542-ea3d-4c5c-8f96-23ff25b76fb1", "field": "max_bytes", "val": "100"} v 0) -- 0x7f0ad8076080 con 0x7f0ad809ed30 2024-09-16T07:50:33.566 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:33.567+0000 7f0aceffd640 1 -- 172.21.15.121:0/570406098 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "989b9542-ea3d-4c5c-8f96-23ff25b76fb1", "field": "max_bytes", "val": "100"}]=0 set-quota max_bytes = 100 for pool 989b9542-ea3d-4c5c-8f96-23ff25b76fb1 v702) ==== 221+0+0 (crc 0 0 0) 0x7f0ac800d610 con 0x7f0ad809ed30 2024-09-16T07:50:33.693 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:33.694+0000 7f0adcd51640 1 -- 172.21.15.121:0/570406098 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "989b9542-ea3d-4c5c-8f96-23ff25b76fb1", "field": "max_bytes", "val": "100"} v 0) -- 0x7f0ad81369a0 con 0x7f0ad809ed30 2024-09-16T07:50:34.567 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:34.568+0000 7f0aceffd640 1 -- 172.21.15.121:0/570406098 <== mon.0 v2:172.21.15.121:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "989b9542-ea3d-4c5c-8f96-23ff25b76fb1", "field": "max_bytes", "val": "100"}]=0 set-quota max_bytes = 100 for pool 989b9542-ea3d-4c5c-8f96-23ff25b76fb1 v703) ==== 221+0+0 (crc 0 0 0) 0x7f0ac800d7f0 con 0x7f0ad809ed30 2024-09-16T07:50:34.567 INFO:tasks.workunit.client.0.smithi121.stderr:set-quota max_bytes = 100 for pool 989b9542-ea3d-4c5c-8f96-23ff25b76fb1 2024-09-16T07:50:34.571 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:34.571+0000 7f0adcd51640 1 -- 172.21.15.121:0/570406098 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f0ab803e910 msgr2=0x7f0ab8040e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:50:34.571 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:34.571+0000 7f0adcd51640 1 --2- 172.21.15.121:0/570406098 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f0ab803e910 0x7f0ab8040e20 crc :-1 s=READY pgs=3821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:50:34.571 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:34.571+0000 7f0adcd51640 1 -- 172.21.15.121:0/570406098 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ad809ed30 msgr2=0x7f0ad8124110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:50:34.571 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:34.571+0000 7f0adcd51640 1 --2- 172.21.15.121:0/570406098 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ad809ed30 0x7f0ad8124110 crc :-1 s=READY pgs=12912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:50:34.571 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:34.571+0000 7f0adcd51640 1 -- 172.21.15.121:0/570406098 shutdown_connections 2024-09-16T07:50:34.571 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:34.571+0000 7f0adcd51640 1 --2- 172.21.15.121:0/570406098 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f0ab803e910 0x7f0ab8040e20 unknown :-1 s=CLOSED pgs=3821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:50:34.571 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:34.571+0000 7f0adcd51640 1 --2- 172.21.15.121:0/570406098 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ad809ed30 0x7f0ad8124110 unknown :-1 s=CLOSED pgs=12912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:50:34.571 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:34.571+0000 7f0adcd51640 1 -- 172.21.15.121:0/570406098 >> 172.21.15.121:0/570406098 conn(0x7f0ad80a5350 msgr2=0x7f0ad80a3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:50:34.571 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:34.571+0000 7f0adcd51640 1 -- 172.21.15.121:0/570406098 shutdown_connections 2024-09-16T07:50:34.571 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:50:34.571+0000 7f0adcd51640 1 -- 172.21.15.121:0/570406098 wait complete. 2024-09-16T07:50:34.585 INFO:tasks.workunit.client.0.smithi121.stderr:+ sleep 30 2024-09-16T07:51:04.587 INFO:tasks.workunit.client.0.smithi121.stderr:+ pid=96190 2024-09-16T07:51:04.588 INFO:tasks.workunit.client.0.smithi121.stderr:+ ceph osd pool set-quota 989b9542-ea3d-4c5c-8f96-23ff25b76fb1 max_bytes 0 2024-09-16T07:51:04.588 INFO:tasks.workunit.client.0.smithi121.stderr:+ rados -p 989b9542-ea3d-4c5c-8f96-23ff25b76fb1 put two /etc/passwd 2024-09-16T07:51:04.634 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.635+0000 7f1e08aefec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:04.639 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.640+0000 7f1e08aefec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:04.640 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.641+0000 7f1e08aefec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:04.640 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.642+0000 7f1e08aefec0 1 Processor -- start 2024-09-16T07:51:04.640 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.642+0000 7f1e08aefec0 1 -- start start 2024-09-16T07:51:04.643 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.643+0000 7f1e08aefec0 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xd649b0 0xcd59b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:51:04.643 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.643+0000 7f1e08aefec0 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0xc36520 con 0xd649b0 2024-09-16T07:51:04.643 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.643+0000 7f1e00e3f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xd649b0 0xcd59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:51:04.643 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.643+0000 7f1e00e3f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xd649b0 0xcd59b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:45172/0 (socket says 172.21.15.121:45172) 2024-09-16T07:51:04.643 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.643+0000 7f1e00e3f640 1 -- 172.21.15.121:0/1580356654 learned_addr learned my addr 172.21.15.121:0/1580356654 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:51:04.643 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.643+0000 7f1e00e3f640 1 -- 172.21.15.121:0/1580356654 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xbd2e10 con 0xd649b0 2024-09-16T07:51:04.643 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.644+0000 7f1e00e3f640 1 --2- 172.21.15.121:0/1580356654 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xd649b0 0xcd59b0 crc :-1 s=READY pgs=12915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9e835e850b8feb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:51:04.643 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.644+0000 7f1dfa7fc640 1 -- 172.21.15.121:0/1580356654 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1dec00b580 con 0xd649b0 2024-09-16T07:51:04.643 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.644+0000 7f1dfa7fc640 1 -- 172.21.15.121:0/1580356654 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1dec00b6e0 con 0xd649b0 2024-09-16T07:51:04.643 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.644+0000 7f1dfa7fc640 1 -- 172.21.15.121:0/1580356654 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1dec00b980 con 0xd649b0 2024-09-16T07:51:04.644 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.645+0000 7f1e08aefec0 1 -- 172.21.15.121:0/1580356654 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xd649b0 msgr2=0xcd59b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:51:04.645 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.645+0000 7f1e08aefec0 1 --2- 172.21.15.121:0/1580356654 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xd649b0 0xcd59b0 crc :-1 s=READY pgs=12915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:04.645 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.645+0000 7f1e08aefec0 1 -- 172.21.15.121:0/1580356654 shutdown_connections 2024-09-16T07:51:04.645 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.645+0000 7f1e08aefec0 1 --2- 172.21.15.121:0/1580356654 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xd649b0 0xcd59b0 unknown :-1 s=CLOSED pgs=12915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:04.645 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.645+0000 7f1e08aefec0 1 -- 172.21.15.121:0/1580356654 >> 172.21.15.121:0/1580356654 conn(0xbf6770 msgr2=0xccde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:51:04.645 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.645+0000 7f1e08aefec0 1 -- 172.21.15.121:0/1580356654 shutdown_connections 2024-09-16T07:51:04.645 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.645+0000 7f1e08aefec0 1 -- 172.21.15.121:0/1580356654 wait complete. 2024-09-16T07:51:04.646 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.647+0000 7f1e08aefec0 1 Processor -- start 2024-09-16T07:51:04.646 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.647+0000 7f1e08aefec0 1 -- start start 2024-09-16T07:51:04.647 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.648+0000 7f1e08aefec0 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xd649b0 0xd50e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:51:04.647 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.648+0000 7f1e08aefec0 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0xc34280 con 0xd649b0 2024-09-16T07:51:04.647 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.648+0000 7f1e00e3f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xd649b0 0xd50e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:51:04.647 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.648+0000 7f1e00e3f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xd649b0 0xd50e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:45184/0 (socket says 172.21.15.121:45184) 2024-09-16T07:51:04.647 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.648+0000 7f1e00e3f640 1 -- 172.21.15.121:0/2518314185 learned_addr learned my addr 172.21.15.121:0/2518314185 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:51:04.648 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.648+0000 7f1e00e3f640 1 -- 172.21.15.121:0/2518314185 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xbc4920 con 0xd649b0 2024-09-16T07:51:04.648 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.649+0000 7f1e00e3f640 1 --2- 172.21.15.121:0/2518314185 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xd649b0 0xd50e70 crc :-1 s=READY pgs=12916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:51:04.648 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.649+0000 7f1df97fa640 1 -- 172.21.15.121:0/2518314185 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1dec012a40 con 0xd649b0 2024-09-16T07:51:04.649 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.649+0000 7f1e08aefec0 1 -- 172.21.15.121:0/2518314185 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0xbc4380 con 0xd649b0 2024-09-16T07:51:04.649 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.649+0000 7f1df97fa640 1 -- 172.21.15.121:0/2518314185 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1dec005040 con 0xd649b0 2024-09-16T07:51:04.649 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.649+0000 7f1df97fa640 1 -- 172.21.15.121:0/2518314185 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1dec012cd0 con 0xd649b0 2024-09-16T07:51:04.649 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.649+0000 7f1e08aefec0 1 -- 172.21.15.121:0/2518314185 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0xd51e00 con 0xd649b0 2024-09-16T07:51:04.650 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.650+0000 7f1df97fa640 1 -- 172.21.15.121:0/2518314185 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f1dec00d040 con 0xd649b0 2024-09-16T07:51:04.650 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.650+0000 7f1df97fa640 1 --2- 172.21.15.121:0/2518314185 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f1de803d170 0x7f1de803f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:51:04.650 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.651+0000 7f1df97fa640 1 -- 172.21.15.121:0/2518314185 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(705..705 src has 620..705) ==== 3819+0+0 (crc 0 0 0) 0x7f1dec00a040 con 0xd649b0 2024-09-16T07:51:04.650 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.651+0000 7f1df97fa640 1 -- 172.21.15.121:0/2518314185 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=706}) -- 0x7f1de8043460 con 0xd649b0 2024-09-16T07:51:04.650 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.651+0000 7f1dfb7fe640 1 --2- 172.21.15.121:0/2518314185 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f1de803d170 0x7f1de803f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:51:04.650 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.651+0000 7f1e08aefec0 1 --2- 172.21.15.121:0/2518314185 >> v2:172.21.15.172:6808/3418488586 conn(0xd654d0 0xdf9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:51:04.651 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.651+0000 7f1dfb7fe640 1 --2- 172.21.15.121:0/2518314185 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f1de803d170 0x7f1de803f680 crc :-1 s=READY pgs=3822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:51:04.651 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.652+0000 7f1e01640640 1 --2- 172.21.15.121:0/2518314185 >> v2:172.21.15.172:6808/3418488586 conn(0xd654d0 0xdf9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T07:51:04.654 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.655+0000 7f1e01640640 1 --2- 172.21.15.121:0/2518314185 >> v2:172.21.15.172:6808/3418488586 conn(0xd654d0 0xdf9cf0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:51:04.709 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.701+0000 7f833bd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:04.710 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.711+0000 7f833bd91640 1 Processor -- start 2024-09-16T07:51:04.710 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.711+0000 7f833bd91640 1 -- start start 2024-09-16T07:51:04.712 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.712+0000 7f833bd91640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f83340733e0 0x7f83341390e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:51:04.712 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.712+0000 7f833bd91640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f833409e510 con 0x7f833409dc80 2024-09-16T07:51:04.712 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.712+0000 7f833bd91640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f8334074a90 con 0x7f83340733e0 2024-09-16T07:51:04.712 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.713+0000 7f833932c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f83340733e0 0x7f83341390e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:51:04.713 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.713+0000 7f833932c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f83340733e0 0x7f83341390e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:45194/0 (socket says 172.21.15.121:45194) 2024-09-16T07:51:04.713 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.713+0000 7f8339b2d640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f833409dc80 0x7f8334072cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:42700/0 (socket says 172.21.15.121:42700) 2024-09-16T07:51:04.713 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.713+0000 7f833932c640 1 -- 172.21.15.121:0/2159025663 learned_addr learned my addr 172.21.15.121:0/2159025663 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:51:04.713 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.713+0000 7f833932c640 1 -- 172.21.15.121:0/2159025663 >> v1:172.21.15.121:6789/0 conn(0x7f833409dc80 legacy=0x7f8334072cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:51:04.713 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.713+0000 7f833932c640 1 -- 172.21.15.121:0/2159025663 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f833409e200 con 0x7f83340733e0 2024-09-16T07:51:04.713 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.713+0000 7f8338b2b640 1 -- 172.21.15.121:0/2159025663 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 670005783 0 0) 0x7f833409e510 con 0x7f833409dc80 2024-09-16T07:51:04.713 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.713+0000 7f833932c640 1 --2- 172.21.15.121:0/2159025663 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f83340733e0 0x7f83341390e0 crc :-1 s=READY pgs=12918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f21e8c7b9ebb98b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:51:04.713 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.713+0000 7f8338b2b640 1 -- 172.21.15.121:0/2159025663 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8324009e50 con 0x7f83340733e0 2024-09-16T07:51:04.713 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.713+0000 7f8338b2b640 1 -- 172.21.15.121:0/2159025663 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f832400e230 con 0x7f83340733e0 2024-09-16T07:51:04.713 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.713+0000 7f8338b2b640 1 -- 172.21.15.121:0/2159025663 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f832400e4d0 con 0x7f83340733e0 2024-09-16T07:51:04.714 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.714+0000 7f833bd91640 1 -- 172.21.15.121:0/2159025663 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f83340733e0 msgr2=0x7f83341390e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:51:04.715 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.714+0000 7f833bd91640 1 --2- 172.21.15.121:0/2159025663 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f83340733e0 0x7f83341390e0 crc :-1 s=READY pgs=12918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:04.715 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.714+0000 7f833bd91640 1 -- 172.21.15.121:0/2159025663 shutdown_connections 2024-09-16T07:51:04.715 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.714+0000 7f833bd91640 1 --2- 172.21.15.121:0/2159025663 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f83340733e0 0x7f83341390e0 unknown :-1 s=CLOSED pgs=12918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:04.715 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.714+0000 7f833bd91640 1 -- 172.21.15.121:0/2159025663 >> 172.21.15.121:0/2159025663 conn(0x7f83340a43d0 msgr2=0x7f83340a47e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:51:04.715 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.714+0000 7f833bd91640 1 -- 172.21.15.121:0/2159025663 shutdown_connections 2024-09-16T07:51:04.715 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.714+0000 7f833bd91640 1 -- 172.21.15.121:0/2159025663 wait complete. 2024-09-16T07:51:04.715 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.715+0000 7f833bd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:04.715 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.716+0000 7f833bd91640 1 Processor -- start 2024-09-16T07:51:04.715 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.716+0000 7f833bd91640 1 -- start start 2024-09-16T07:51:04.717 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.717+0000 7f833bd91640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f83340733e0 0x7f8334121a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:51:04.717 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.717+0000 7f833bd91640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8334125300 con 0x7f83340733e0 2024-09-16T07:51:04.717 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.717+0000 7f8339b2d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f83340733e0 0x7f8334121a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:51:04.717 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.717+0000 7f8339b2d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f83340733e0 0x7f8334121a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:45202/0 (socket says 172.21.15.121:45202) 2024-09-16T07:51:04.717 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.717+0000 7f8339b2d640 1 -- 172.21.15.121:0/3069232973 learned_addr learned my addr 172.21.15.121:0/3069232973 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:51:04.717 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.717+0000 7f8339b2d640 1 -- 172.21.15.121:0/3069232973 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83341234c0 con 0x7f83340733e0 2024-09-16T07:51:04.717 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.718+0000 7f8339b2d640 1 --2- 172.21.15.121:0/3069232973 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f83340733e0 0x7f8334121a40 crc :-1 s=READY pgs=12919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:51:04.717 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.718+0000 7f832a7fc640 1 -- 172.21.15.121:0/3069232973 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f83300070b0 con 0x7f83340733e0 2024-09-16T07:51:04.717 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.718+0000 7f832a7fc640 1 -- 172.21.15.121:0/3069232973 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f8330007210 con 0x7f83340733e0 2024-09-16T07:51:04.718 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.718+0000 7f833bd91640 1 -- 172.21.15.121:0/3069232973 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8334125560 con 0x7f83340733e0 2024-09-16T07:51:04.718 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.718+0000 7f832a7fc640 1 -- 172.21.15.121:0/3069232973 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f83300074b0 con 0x7f83340733e0 2024-09-16T07:51:04.718 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.718+0000 7f833bd91640 1 -- 172.21.15.121:0/3069232973 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8334124370 con 0x7f83340733e0 2024-09-16T07:51:04.719 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.719+0000 7f833bd91640 1 -- 172.21.15.121:0/3069232973 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f833409ef50 con 0x7f83340733e0 2024-09-16T07:51:04.719 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.719+0000 7f832a7fc640 1 -- 172.21.15.121:0/3069232973 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f8330007660 con 0x7f83340733e0 2024-09-16T07:51:04.719 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.719+0000 7f832a7fc640 1 --2- 172.21.15.121:0/3069232973 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f831803e930 0x7f8318040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:51:04.719 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.719+0000 7f832a7fc640 1 -- 172.21.15.121:0/3069232973 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(705..705 src has 620..705) ==== 3819+0+0 (crc 0 0 0) 0x7f83300506d0 con 0x7f83340733e0 2024-09-16T07:51:04.719 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.719+0000 7f832a7fc640 1 -- 172.21.15.121:0/3069232973 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=706}) -- 0x7f8318044bc0 con 0x7f83340733e0 2024-09-16T07:51:04.719 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.719+0000 7f833932c640 1 --2- 172.21.15.121:0/3069232973 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f831803e930 0x7f8318040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:51:04.720 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.720+0000 7f833932c640 1 --2- 172.21.15.121:0/3069232973 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f831803e930 0x7f8318040e40 crc :-1 s=READY pgs=3823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:51:04.723 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.724+0000 7f832a7fc640 1 -- 172.21.15.121:0/3069232973 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f833000fe60 con 0x7f83340733e0 2024-09-16T07:51:04.902 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:04.903+0000 7f833bd91640 1 -- 172.21.15.121:0/3069232973 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "989b9542-ea3d-4c5c-8f96-23ff25b76fb1", "field": "max_bytes", "val": "0"} v 0) -- 0x7f8334072cd0 con 0x7f83340733e0 2024-09-16T07:51:05.614 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:05.614+0000 7f832a7fc640 1 -- 172.21.15.121:0/3069232973 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "989b9542-ea3d-4c5c-8f96-23ff25b76fb1", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool 989b9542-ea3d-4c5c-8f96-23ff25b76fb1 v706) ==== 217+0+0 (crc 0 0 0) 0x7f833000ae00 con 0x7f83340733e0 2024-09-16T07:51:05.616 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:05.617+0000 7f1df97fa640 1 -- 172.21.15.121:0/2518314185 <== mon.0 v2:172.21.15.121:3300/0 6 ==== osd_map(706..706 src has 620..706) ==== 628+0+0 (crc 0 0 0) 0x7f1dec0077b0 con 0xd649b0 2024-09-16T07:51:05.616 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:05.617+0000 7f832a7fc640 1 -- 172.21.15.121:0/3069232973 <== mon.0 v2:172.21.15.121:3300/0 8 ==== osd_map(706..706 src has 620..706) ==== 628+0+0 (crc 0 0 0) 0x7f833000ddf0 con 0x7f83340733e0 2024-09-16T07:51:05.616 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:05.617+0000 7f1df97fa640 1 -- 172.21.15.121:0/2518314185 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=707}) -- 0x7f1de8043ba0 con 0xd649b0 2024-09-16T07:51:05.616 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:05.617+0000 7f832a7fc640 1 -- 172.21.15.121:0/3069232973 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=707}) -- 0x7f8318045a70 con 0x7f83340733e0 2024-09-16T07:51:05.730 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:05.731+0000 7f833bd91640 1 -- 172.21.15.121:0/3069232973 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "989b9542-ea3d-4c5c-8f96-23ff25b76fb1", "field": "max_bytes", "val": "0"} v 0) -- 0x7f83340008d0 con 0x7f83340733e0 2024-09-16T07:51:06.615 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:06.615+0000 7f832a7fc640 1 -- 172.21.15.121:0/3069232973 <== mon.0 v2:172.21.15.121:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "989b9542-ea3d-4c5c-8f96-23ff25b76fb1", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool 989b9542-ea3d-4c5c-8f96-23ff25b76fb1 v707) ==== 217+0+0 (crc 0 0 0) 0x7f83300090b0 con 0x7f83340733e0 2024-09-16T07:51:06.615 INFO:tasks.workunit.client.0.smithi121.stderr:set-quota max_bytes = 0 for pool 989b9542-ea3d-4c5c-8f96-23ff25b76fb1 2024-09-16T07:51:06.618 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:06.618+0000 7f832a7fc640 1 -- 172.21.15.121:0/3069232973 <== mon.0 v2:172.21.15.121:3300/0 10 ==== osd_map(707..707 src has 620..707) ==== 628+0+0 (crc 0 0 0) 0x7f833000ede0 con 0x7f83340733e0 2024-09-16T07:51:06.618 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:06.618+0000 7f832a7fc640 1 -- 172.21.15.121:0/3069232973 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=708}) -- 0x7f8318045d20 con 0x7f83340733e0 2024-09-16T07:51:06.618 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:06.618+0000 7f1df97fa640 1 -- 172.21.15.121:0/2518314185 <== mon.0 v2:172.21.15.121:3300/0 7 ==== osd_map(707..707 src has 620..707) ==== 628+0+0 (crc 0 0 0) 0x7f1dec0030d0 con 0xd649b0 2024-09-16T07:51:06.618 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:06.618+0000 7f1df97fa640 1 -- 172.21.15.121:0/2518314185 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=708}) -- 0x7f1de8043dc0 con 0xd649b0 2024-09-16T07:51:06.618 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:06.618+0000 7f833bd91640 1 -- 172.21.15.121:0/3069232973 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f831803e930 msgr2=0x7f8318040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:51:06.618 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:06.618+0000 7f833bd91640 1 --2- 172.21.15.121:0/3069232973 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f831803e930 0x7f8318040e40 crc :-1 s=READY pgs=3823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:06.618 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:06.618+0000 7f833bd91640 1 -- 172.21.15.121:0/3069232973 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f83340733e0 msgr2=0x7f8334121a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:51:06.619 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:06.618+0000 7f833bd91640 1 --2- 172.21.15.121:0/3069232973 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f83340733e0 0x7f8334121a40 crc :-1 s=READY pgs=12919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:06.619 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:06.619+0000 7f833bd91640 1 -- 172.21.15.121:0/3069232973 shutdown_connections 2024-09-16T07:51:06.619 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:06.619+0000 7f833bd91640 1 --2- 172.21.15.121:0/3069232973 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f831803e930 0x7f8318040e40 unknown :-1 s=CLOSED pgs=3823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:06.619 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:06.619+0000 7f833bd91640 1 --2- 172.21.15.121:0/3069232973 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f83340733e0 0x7f8334121a40 unknown :-1 s=CLOSED pgs=12919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:06.619 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:06.619+0000 7f833bd91640 1 -- 172.21.15.121:0/3069232973 >> 172.21.15.121:0/3069232973 conn(0x7f83340a43d0 msgr2=0x7f83340a0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:51:06.619 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:06.619+0000 7f833bd91640 1 -- 172.21.15.121:0/3069232973 shutdown_connections 2024-09-16T07:51:06.619 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:06.619+0000 7f833bd91640 1 -- 172.21.15.121:0/3069232973 wait complete. 2024-09-16T07:51:06.631 INFO:tasks.workunit.client.0.smithi121.stderr:+ ceph osd pool set-quota 989b9542-ea3d-4c5c-8f96-23ff25b76fb1 max_objects 0 2024-09-16T07:51:06.734 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:06.727+0000 7fadea991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:06.735 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:06.736+0000 7fadea991640 1 Processor -- start 2024-09-16T07:51:06.735 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:06.736+0000 7fadea991640 1 -- start start 2024-09-16T07:51:06.737 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:06.737+0000 7fadea991640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fade40a0a50 0x7fade40a0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:51:06.737 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:06.737+0000 7fadea991640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fade40a0470 con 0x7fade4133b60 2024-09-16T07:51:06.737 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:06.737+0000 7fadea991640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fade409ed30 con 0x7fade40a0a50 2024-09-16T07:51:06.737 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:06.737+0000 7fade3fff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fade40a0a50 0x7fade40a0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:51:06.737 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:06.737+0000 7fade37fe640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fade4133b60 0x7fade4133f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:42706/0 (socket says 172.21.15.121:42706) 2024-09-16T07:51:06.737 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:06.737+0000 7fade3fff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fade40a0a50 0x7fade40a0e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:45204/0 (socket says 172.21.15.121:45204) 2024-09-16T07:51:06.737 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:06.737+0000 7fade37fe640 1 -- 172.21.15.121:0/1994421668 learned_addr learned my addr 172.21.15.121:0/1994421668 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-16T07:51:06.737 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:06.738+0000 7fade3fff640 1 -- 172.21.15.121:0/1994421668 >> v1:172.21.15.121:6789/0 conn(0x7fade4133b60 legacy=0x7fade4133f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:51:06.738 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:06.738+0000 7fade3fff640 1 -- 172.21.15.121:0/1994421668 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fade40a13a0 con 0x7fade40a0a50 2024-09-16T07:51:06.738 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:06.738+0000 7fade2ffd640 1 -- 172.21.15.121:0/1994421668 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1467676516 0 0) 0x7fade40a0470 con 0x7fade4133b60 2024-09-16T07:51:06.738 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:06.738+0000 7fade3fff640 1 --2- 172.21.15.121:0/1994421668 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fade40a0a50 0x7fade40a0e60 crc :-1 s=READY pgs=12921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4dfa30bb91812c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:51:06.738 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:06.738+0000 7fade2ffd640 1 -- 172.21.15.121:0/1994421668 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fadd4009d90 con 0x7fade40a0a50 2024-09-16T07:51:06.738 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:06.738+0000 7fade2ffd640 1 -- 172.21.15.121:0/1994421668 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fadd400e230 con 0x7fade40a0a50 2024-09-16T07:51:06.738 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:06.738+0000 7fade2ffd640 1 -- 172.21.15.121:0/1994421668 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fadd400e4d0 con 0x7fade40a0a50 2024-09-16T07:51:06.739 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:06.739+0000 7fadea991640 1 -- 172.21.15.121:0/1994421668 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fade40a0a50 msgr2=0x7fade40a0e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:51:06.739 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:06.739+0000 7fadea991640 1 --2- 172.21.15.121:0/1994421668 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fade40a0a50 0x7fade40a0e60 crc :-1 s=READY pgs=12921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:06.739 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:06.739+0000 7fadea991640 1 -- 172.21.15.121:0/1994421668 shutdown_connections 2024-09-16T07:51:06.739 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:06.739+0000 7fadea991640 1 --2- 172.21.15.121:0/1994421668 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fade40a0a50 0x7fade40a0e60 unknown :-1 s=CLOSED pgs=12921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:06.739 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:06.739+0000 7fadea991640 1 -- 172.21.15.121:0/1994421668 >> 172.21.15.121:0/1994421668 conn(0x7fade409d9e0 msgr2=0x7fade409ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:51:06.740 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:06.739+0000 7fadea991640 1 -- 172.21.15.121:0/1994421668 shutdown_connections 2024-09-16T07:51:06.740 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:06.739+0000 7fadea991640 1 -- 172.21.15.121:0/1994421668 wait complete. 2024-09-16T07:51:06.740 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:06.739+0000 7fadea991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:06.740 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:06.740+0000 7fadea991640 1 Processor -- start 2024-09-16T07:51:06.740 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:06.741+0000 7fadea991640 1 -- start start 2024-09-16T07:51:06.741 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:06.742+0000 7fadea991640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fade40a0a50 0x7fade406fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:51:06.741 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:06.742+0000 7fadea991640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fade4071020 con 0x7fade40a0a50 2024-09-16T07:51:06.741 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:06.742+0000 7fade3fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fade40a0a50 0x7fade406fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:51:06.741 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:06.742+0000 7fade3fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fade40a0a50 0x7fade406fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:45212/0 (socket says 172.21.15.121:45212) 2024-09-16T07:51:06.742 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:06.742+0000 7fade3fff640 1 -- 172.21.15.121:0/3142672844 learned_addr learned my addr 172.21.15.121:0/3142672844 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:51:06.742 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:06.742+0000 7fade3fff640 1 -- 172.21.15.121:0/3142672844 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fade4123230 con 0x7fade40a0a50 2024-09-16T07:51:06.743 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:06.742+0000 7fade3fff640 1 --2- 172.21.15.121:0/3142672844 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fade40a0a50 0x7fade406fd90 crc :-1 s=READY pgs=12922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:51:06.743 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:06.742+0000 7fade0ff9640 1 -- 172.21.15.121:0/3142672844 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fadd4013610 con 0x7fade40a0a50 2024-09-16T07:51:06.743 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:06.742+0000 7fade0ff9640 1 -- 172.21.15.121:0/3142672844 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fadd4013770 con 0x7fade40a0a50 2024-09-16T07:51:06.743 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:06.742+0000 7fadea991640 1 -- 172.21.15.121:0/3142672844 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fade406f590 con 0x7fade40a0a50 2024-09-16T07:51:06.743 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:06.742+0000 7fade0ff9640 1 -- 172.21.15.121:0/3142672844 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fadd4013a10 con 0x7fade40a0a50 2024-09-16T07:51:06.743 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:06.742+0000 7fadea991640 1 -- 172.21.15.121:0/3142672844 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fade412d920 con 0x7fade40a0a50 2024-09-16T07:51:06.744 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:06.743+0000 7fade0ff9640 1 -- 172.21.15.121:0/3142672844 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fadd4013bc0 con 0x7fade40a0a50 2024-09-16T07:51:06.744 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:06.743+0000 7fadea991640 1 -- 172.21.15.121:0/3142672844 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fade409e8b0 con 0x7fade40a0a50 2024-09-16T07:51:06.744 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:06.744+0000 7fade0ff9640 1 --2- 172.21.15.121:0/3142672844 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fadd003e960 0x7fadd0040e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:51:06.744 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:06.744+0000 7fade0ff9640 1 -- 172.21.15.121:0/3142672844 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(707..707 src has 620..707) ==== 3819+0+0 (crc 0 0 0) 0x7fadd4018040 con 0x7fade40a0a50 2024-09-16T07:51:06.744 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:06.744+0000 7fade0ff9640 1 -- 172.21.15.121:0/3142672844 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=708}) -- 0x7fadd0044c50 con 0x7fade40a0a50 2024-09-16T07:51:06.745 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:06.744+0000 7fade37fe640 1 --2- 172.21.15.121:0/3142672844 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fadd003e960 0x7fadd0040e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:51:06.745 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:06.745+0000 7fade37fe640 1 --2- 172.21.15.121:0/3142672844 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fadd003e960 0x7fadd0040e70 crc :-1 s=READY pgs=3824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:51:06.748 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:06.749+0000 7fade0ff9640 1 -- 172.21.15.121:0/3142672844 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fadd4011570 con 0x7fade40a0a50 2024-09-16T07:51:06.930 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:06.931+0000 7fadea991640 1 -- 172.21.15.121:0/3142672844 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "989b9542-ea3d-4c5c-8f96-23ff25b76fb1", "field": "max_objects", "val": "0"} v 0) -- 0x7fade4077d00 con 0x7fade40a0a50 2024-09-16T07:51:07.486 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:07.487+0000 7fade0ff9640 1 -- 172.21.15.121:0/3142672844 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "989b9542-ea3d-4c5c-8f96-23ff25b76fb1", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool 989b9542-ea3d-4c5c-8f96-23ff25b76fb1 v708) ==== 221+0+0 (crc 0 0 0) 0x7fadd4017190 con 0x7fade40a0a50 2024-09-16T07:51:07.488 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:07.489+0000 7f1df97fa640 1 -- 172.21.15.121:0/2518314185 <== mon.0 v2:172.21.15.121:3300/0 8 ==== osd_map(708..708 src has 620..708) ==== 628+0+0 (crc 0 0 0) 0x7f1dec0113f0 con 0xd649b0 2024-09-16T07:51:07.488 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:07.489+0000 7fade0ff9640 1 -- 172.21.15.121:0/3142672844 <== mon.0 v2:172.21.15.121:3300/0 8 ==== osd_map(708..708 src has 620..708) ==== 628+0+0 (crc 0 0 0) 0x7fadd4012e30 con 0x7fade40a0a50 2024-09-16T07:51:07.488 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:07.490+0000 7fade0ff9640 1 -- 172.21.15.121:0/3142672844 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=709}) -- 0x7fadd0045b20 con 0x7fade40a0a50 2024-09-16T07:51:07.489 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:07.490+0000 7f1df97fa640 1 -- 172.21.15.121:0/2518314185 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=709}) -- 0x7f1de8043fe0 con 0xd649b0 2024-09-16T07:51:07.489 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:07.490+0000 7f1df97fa640 1 -- 172.21.15.121:0/2518314185 --> v2:172.21.15.172:6808/3418488586 -- osd_op(unknown.0.0:1 199.6 199:6b5d76a5:::two:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e708) -- 0x7f1de80441d0 con 0xd654d0 2024-09-16T07:51:07.536 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:07.536+0000 7f1e01640640 1 -- 172.21.15.121:0/2518314185 <== osd.3 v2:172.21.15.172:6808/3418488586 1 ==== osd_op_reply(1 two [writefull 0~12875] v708'2 uv2 ondisk = 0) ==== 147+0+0 (crc 0 0 0) 0x7f1df400a430 con 0xd654d0 2024-09-16T07:51:07.536 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:07.536+0000 7f1e08aefec0 1 -- 172.21.15.121:0/2518314185 >> v2:172.21.15.172:6808/3418488586 conn(0xd654d0 msgr2=0xdf9cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:51:07.536 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:07.536+0000 7f1e08aefec0 1 --2- 172.21.15.121:0/2518314185 >> v2:172.21.15.172:6808/3418488586 conn(0xd654d0 0xdf9cf0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:07.537 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:07.536+0000 7f1e08aefec0 1 -- 172.21.15.121:0/2518314185 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f1de803d170 msgr2=0x7f1de803f680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:51:07.537 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:07.536+0000 7f1e08aefec0 1 --2- 172.21.15.121:0/2518314185 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f1de803d170 0x7f1de803f680 crc :-1 s=READY pgs=3822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:07.537 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:07.536+0000 7f1e08aefec0 1 -- 172.21.15.121:0/2518314185 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xd649b0 msgr2=0xd50e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:51:07.537 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:07.536+0000 7f1e08aefec0 1 --2- 172.21.15.121:0/2518314185 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xd649b0 0xd50e70 crc :-1 s=READY pgs=12916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:07.537 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:07.536+0000 7f1e08aefec0 1 -- 172.21.15.121:0/2518314185 shutdown_connections 2024-09-16T07:51:07.537 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:07.536+0000 7f1e08aefec0 1 --2- 172.21.15.121:0/2518314185 >> v2:172.21.15.172:6808/3418488586 conn(0xd654d0 0xdf9cf0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:07.537 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:07.536+0000 7f1e08aefec0 1 --2- 172.21.15.121:0/2518314185 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f1de803d170 0x7f1de803f680 unknown :-1 s=CLOSED pgs=3822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:07.537 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:07.536+0000 7f1e08aefec0 1 --2- 172.21.15.121:0/2518314185 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xd649b0 0xd50e70 unknown :-1 s=CLOSED pgs=12916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:07.537 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:07.536+0000 7f1e08aefec0 1 -- 172.21.15.121:0/2518314185 >> 172.21.15.121:0/2518314185 conn(0xbf6770 msgr2=0xccdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:51:07.537 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:07.537+0000 7f1e08aefec0 1 -- 172.21.15.121:0/2518314185 shutdown_connections 2024-09-16T07:51:07.537 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:07.537+0000 7f1e08aefec0 1 -- 172.21.15.121:0/2518314185 wait complete. 2024-09-16T07:51:07.607 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:07.608+0000 7fadea991640 1 -- 172.21.15.121:0/3142672844 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "989b9542-ea3d-4c5c-8f96-23ff25b76fb1", "field": "max_objects", "val": "0"} v 0) -- 0x7fade4122d20 con 0x7fade40a0a50 2024-09-16T07:51:08.487 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.488+0000 7fade0ff9640 1 -- 172.21.15.121:0/3142672844 <== mon.0 v2:172.21.15.121:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "989b9542-ea3d-4c5c-8f96-23ff25b76fb1", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool 989b9542-ea3d-4c5c-8f96-23ff25b76fb1 v709) ==== 221+0+0 (crc 0 0 0) 0x7fadd4011380 con 0x7fade40a0a50 2024-09-16T07:51:08.487 INFO:tasks.workunit.client.0.smithi121.stderr:set-quota max_objects = 0 for pool 989b9542-ea3d-4c5c-8f96-23ff25b76fb1 2024-09-16T07:51:08.487 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.488+0000 7fade0ff9640 1 -- 172.21.15.121:0/3142672844 <== mon.0 v2:172.21.15.121:3300/0 10 ==== osd_map(709..709 src has 620..709) ==== 628+0+0 (crc 0 0 0) 0x7fadd400f2a0 con 0x7fade40a0a50 2024-09-16T07:51:08.490 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.491+0000 7fadea991640 1 -- 172.21.15.121:0/3142672844 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fadd003e960 msgr2=0x7fadd0040e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:51:08.490 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.491+0000 7fadea991640 1 --2- 172.21.15.121:0/3142672844 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fadd003e960 0x7fadd0040e70 crc :-1 s=READY pgs=3824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:08.491 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.491+0000 7fadea991640 1 -- 172.21.15.121:0/3142672844 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fade40a0a50 msgr2=0x7fade406fd90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:51:08.491 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.491+0000 7fadea991640 1 --2- 172.21.15.121:0/3142672844 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fade40a0a50 0x7fade406fd90 crc :-1 s=READY pgs=12922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:08.491 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.491+0000 7fadea991640 1 -- 172.21.15.121:0/3142672844 shutdown_connections 2024-09-16T07:51:08.491 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.491+0000 7fadea991640 1 --2- 172.21.15.121:0/3142672844 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fadd003e960 0x7fadd0040e70 unknown :-1 s=CLOSED pgs=3824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:08.491 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.491+0000 7fadea991640 1 --2- 172.21.15.121:0/3142672844 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fade40a0a50 0x7fade406fd90 unknown :-1 s=CLOSED pgs=12922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:08.491 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.491+0000 7fadea991640 1 -- 172.21.15.121:0/3142672844 >> 172.21.15.121:0/3142672844 conn(0x7fade409d9e0 msgr2=0x7fade4074430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:51:08.491 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.492+0000 7fadea991640 1 -- 172.21.15.121:0/3142672844 shutdown_connections 2024-09-16T07:51:08.491 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.492+0000 7fadea991640 1 -- 172.21.15.121:0/3142672844 wait complete. 2024-09-16T07:51:08.506 INFO:tasks.workunit.client.0.smithi121.stderr:+ wait 96190 2024-09-16T07:51:08.506 INFO:tasks.workunit.client.0.smithi121.stderr:+ '[' 0 -ne 0 ']' 2024-09-16T07:51:08.506 INFO:tasks.workunit.client.0.smithi121.stderr:+ true 2024-09-16T07:51:08.506 INFO:tasks.workunit.client.0.smithi121.stderr:+ rados -p 989b9542-ea3d-4c5c-8f96-23ff25b76fb1 put three /etc/passwd 2024-09-16T07:51:08.553 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.554+0000 7fbe3e4feec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:08.558 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.559+0000 7fbe3e4feec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:08.558 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.559+0000 7fbe3e4feec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:08.558 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.560+0000 7fbe3e4feec0 1 Processor -- start 2024-09-16T07:51:08.558 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.560+0000 7fbe3e4feec0 1 -- start start 2024-09-16T07:51:08.560 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.561+0000 7fbe3e4feec0 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xe4b300 0xf65740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:51:08.560 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.561+0000 7fbe3e4feec0 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0xdaf520 con 0xe4b300 2024-09-16T07:51:08.560 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.561+0000 7fbe3699b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xe4b300 0xf65740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:51:08.560 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.561+0000 7fbe3699b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xe4b300 0xf65740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:45230/0 (socket says 172.21.15.121:45230) 2024-09-16T07:51:08.560 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.561+0000 7fbe3699b640 1 -- 172.21.15.121:0/1255511778 learned_addr learned my addr 172.21.15.121:0/1255511778 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:51:08.561 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.561+0000 7fbe3699b640 1 -- 172.21.15.121:0/1255511778 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xd4be10 con 0xe4b300 2024-09-16T07:51:08.561 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.561+0000 7fbe3699b640 1 --2- 172.21.15.121:0/1255511778 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xe4b300 0xf65740 crc :-1 s=READY pgs=12925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3e95b9fcb59cfed server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:51:08.561 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.561+0000 7fbe35198640 1 -- 172.21.15.121:0/1255511778 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbe2000c770 con 0xe4b300 2024-09-16T07:51:08.561 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.561+0000 7fbe35198640 1 -- 172.21.15.121:0/1255511778 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fbe2000c8d0 con 0xe4b300 2024-09-16T07:51:08.561 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.561+0000 7fbe35198640 1 -- 172.21.15.121:0/1255511778 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbe2000cb70 con 0xe4b300 2024-09-16T07:51:08.563 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.562+0000 7fbe3e4feec0 1 -- 172.21.15.121:0/1255511778 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xe4b300 msgr2=0xf65740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:51:08.563 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.562+0000 7fbe3e4feec0 1 --2- 172.21.15.121:0/1255511778 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xe4b300 0xf65740 crc :-1 s=READY pgs=12925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:08.563 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.562+0000 7fbe3e4feec0 1 -- 172.21.15.121:0/1255511778 shutdown_connections 2024-09-16T07:51:08.563 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.562+0000 7fbe3e4feec0 1 --2- 172.21.15.121:0/1255511778 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xe4b300 0xf65740 unknown :-1 s=CLOSED pgs=12925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:08.563 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.562+0000 7fbe3e4feec0 1 -- 172.21.15.121:0/1255511778 >> 172.21.15.121:0/1255511778 conn(0xd6f770 msgr2=0xe4d6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:51:08.563 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.562+0000 7fbe3e4feec0 1 -- 172.21.15.121:0/1255511778 shutdown_connections 2024-09-16T07:51:08.563 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.562+0000 7fbe3e4feec0 1 -- 172.21.15.121:0/1255511778 wait complete. 2024-09-16T07:51:08.563 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.563+0000 7fbe3e4feec0 1 Processor -- start 2024-09-16T07:51:08.564 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.563+0000 7fbe3e4feec0 1 -- start start 2024-09-16T07:51:08.564 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.564+0000 7fbe3e4feec0 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xe4b300 0xec8760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:51:08.564 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.564+0000 7fbe3e4feec0 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0xdad280 con 0xe4b300 2024-09-16T07:51:08.564 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.564+0000 7fbe3699b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xe4b300 0xec8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:51:08.564 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.564+0000 7fbe3699b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xe4b300 0xec8760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:45232/0 (socket says 172.21.15.121:45232) 2024-09-16T07:51:08.564 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.564+0000 7fbe3699b640 1 -- 172.21.15.121:0/940525313 learned_addr learned my addr 172.21.15.121:0/940525313 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:51:08.566 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.564+0000 7fbe3699b640 1 -- 172.21.15.121:0/940525313 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xd3d920 con 0xe4b300 2024-09-16T07:51:08.566 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.565+0000 7fbe3699b640 1 --2- 172.21.15.121:0/940525313 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xe4b300 0xec8760 crc :-1 s=READY pgs=12926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:51:08.566 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.565+0000 7fbe2f7fe640 1 -- 172.21.15.121:0/940525313 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbe20012040 con 0xe4b300 2024-09-16T07:51:08.566 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.565+0000 7fbe2f7fe640 1 -- 172.21.15.121:0/940525313 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fbe20013040 con 0xe4b300 2024-09-16T07:51:08.566 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.565+0000 7fbe3e4feec0 1 -- 172.21.15.121:0/940525313 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0xd3d380 con 0xe4b300 2024-09-16T07:51:08.566 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.565+0000 7fbe2f7fe640 1 -- 172.21.15.121:0/940525313 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbe200093a0 con 0xe4b300 2024-09-16T07:51:08.566 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.565+0000 7fbe3e4feec0 1 -- 172.21.15.121:0/940525313 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0xecc550 con 0xe4b300 2024-09-16T07:51:08.566 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.566+0000 7fbe2f7fe640 1 -- 172.21.15.121:0/940525313 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fbe20009500 con 0xe4b300 2024-09-16T07:51:08.566 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.566+0000 7fbe2f7fe640 1 --2- 172.21.15.121:0/940525313 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fbe1c03d1c0 0x7fbe1c03f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:51:08.566 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.566+0000 7fbe2f7fe640 1 -- 172.21.15.121:0/940525313 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(709..709 src has 620..709) ==== 3819+0+0 (crc 0 0 0) 0x7fbe20051a30 con 0xe4b300 2024-09-16T07:51:08.566 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.566+0000 7fbe3e4feec0 1 --2- 172.21.15.121:0/940525313 >> v2:172.21.15.172:6808/3418488586 conn(0xe4be20 0xf70800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:51:08.566 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.566+0000 7fbe3e4feec0 1 -- 172.21.15.121:0/940525313 --> v2:172.21.15.172:6808/3418488586 -- osd_op(unknown.0.0:1 199.3 199:c57798d7:::three:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e709) -- 0xecbfe0 con 0xe4be20 2024-09-16T07:51:08.567 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.566+0000 7fbe3619a640 1 --2- 172.21.15.121:0/940525313 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fbe1c03d1c0 0x7fbe1c03f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:51:08.567 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.567+0000 7fbe3619a640 1 --2- 172.21.15.121:0/940525313 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fbe1c03d1c0 0x7fbe1c03f6d0 crc :-1 s=READY pgs=3825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:51:08.567 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.567+0000 7fbe3719c640 1 --2- 172.21.15.121:0/940525313 >> v2:172.21.15.172:6808/3418488586 conn(0xe4be20 0xf70800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T07:51:08.570 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.572+0000 7fbe3719c640 1 --2- 172.21.15.121:0/940525313 >> v2:172.21.15.172:6808/3418488586 conn(0xe4be20 0xf70800 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:51:08.587 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.587+0000 7fbe3719c640 1 -- 172.21.15.121:0/940525313 <== osd.3 v2:172.21.15.172:6808/3418488586 1 ==== osd_op_reply(1 three [writefull 0~12875] v709'2 uv2 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbe2800a430 con 0xe4be20 2024-09-16T07:51:08.587 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.588+0000 7fbe3e4feec0 1 -- 172.21.15.121:0/940525313 >> v2:172.21.15.172:6808/3418488586 conn(0xe4be20 msgr2=0xf70800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:51:08.587 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.588+0000 7fbe3e4feec0 1 --2- 172.21.15.121:0/940525313 >> v2:172.21.15.172:6808/3418488586 conn(0xe4be20 0xf70800 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:08.587 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.588+0000 7fbe3e4feec0 1 -- 172.21.15.121:0/940525313 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fbe1c03d1c0 msgr2=0x7fbe1c03f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:51:08.587 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.588+0000 7fbe3e4feec0 1 --2- 172.21.15.121:0/940525313 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fbe1c03d1c0 0x7fbe1c03f6d0 crc :-1 s=READY pgs=3825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:08.587 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.588+0000 7fbe3e4feec0 1 -- 172.21.15.121:0/940525313 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xe4b300 msgr2=0xec8760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:51:08.587 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.588+0000 7fbe3e4feec0 1 --2- 172.21.15.121:0/940525313 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xe4b300 0xec8760 crc :-1 s=READY pgs=12926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:08.588 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.588+0000 7fbe3e4feec0 1 -- 172.21.15.121:0/940525313 shutdown_connections 2024-09-16T07:51:08.588 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.588+0000 7fbe3e4feec0 1 --2- 172.21.15.121:0/940525313 >> v2:172.21.15.172:6808/3418488586 conn(0xe4be20 0xf70800 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:08.588 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.588+0000 7fbe3e4feec0 1 --2- 172.21.15.121:0/940525313 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fbe1c03d1c0 0x7fbe1c03f6d0 unknown :-1 s=CLOSED pgs=3825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:08.588 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.588+0000 7fbe3e4feec0 1 --2- 172.21.15.121:0/940525313 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xe4b300 0xec8760 unknown :-1 s=CLOSED pgs=12926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:08.588 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.588+0000 7fbe3e4feec0 1 -- 172.21.15.121:0/940525313 >> 172.21.15.121:0/940525313 conn(0xd6f770 msgr2=0xe4d6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:51:08.588 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.588+0000 7fbe3e4feec0 1 -- 172.21.15.121:0/940525313 shutdown_connections 2024-09-16T07:51:08.588 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.588+0000 7fbe3e4feec0 1 -- 172.21.15.121:0/940525313 wait complete. 2024-09-16T07:51:08.589 INFO:tasks.workunit.client.0.smithi121.stderr:++ uuidgen 2024-09-16T07:51:08.590 INFO:tasks.workunit.client.0.smithi121.stderr:+ pp=d3276ed3-e996-4bbc-b28e-567739f7faa8 2024-09-16T07:51:08.590 INFO:tasks.workunit.client.0.smithi121.stderr:+ ceph osd pool create d3276ed3-e996-4bbc-b28e-567739f7faa8 12 2024-09-16T07:51:08.683 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.677+0000 7f5ef4391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:08.684 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.685+0000 7f5ef4391640 1 Processor -- start 2024-09-16T07:51:08.684 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.685+0000 7f5ef4391640 1 -- start start 2024-09-16T07:51:08.685 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.686+0000 7f5ef4391640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f5eec0724d0 0x7f5eec0728e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:51:08.686 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.686+0000 7f5ef4391640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5eec06c4d0 con 0x7f5eec072e20 2024-09-16T07:51:08.686 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.687+0000 7f5ef4391640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f5eec08ef70 con 0x7f5eec0724d0 2024-09-16T07:51:08.686 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.687+0000 7f5ef212d640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f5eec0724d0 0x7f5eec0728e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:51:08.686 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.687+0000 7f5ef192c640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f5eec072e20 0x7f5eec137740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:42736/0 (socket says 172.21.15.121:42736) 2024-09-16T07:51:08.686 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.687+0000 7f5ef212d640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f5eec0724d0 0x7f5eec0728e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:45236/0 (socket says 172.21.15.121:45236) 2024-09-16T07:51:08.686 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.687+0000 7f5ef192c640 1 -- 172.21.15.121:0/3809537033 learned_addr learned my addr 172.21.15.121:0/3809537033 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-16T07:51:08.687 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.687+0000 7f5ef212d640 1 -- 172.21.15.121:0/3809537033 >> v1:172.21.15.121:6789/0 conn(0x7f5eec072e20 legacy=0x7f5eec137740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:51:08.687 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.687+0000 7f5ef212d640 1 -- 172.21.15.121:0/3809537033 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5eec0736d0 con 0x7f5eec0724d0 2024-09-16T07:51:08.687 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.687+0000 7f5ef112b640 1 -- 172.21.15.121:0/3809537033 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3517011085 0 0) 0x7f5eec06c4d0 con 0x7f5eec072e20 2024-09-16T07:51:08.688 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.687+0000 7f5ef212d640 1 --2- 172.21.15.121:0/3809537033 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5eec0724d0 0x7f5eec0728e0 crc :-1 s=READY pgs=12928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcb3add93dea003f server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:51:08.688 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.687+0000 7f5ef112b640 1 -- 172.21.15.121:0/3809537033 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5edc00e040 con 0x7f5eec0724d0 2024-09-16T07:51:08.688 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.687+0000 7f5ef112b640 1 -- 172.21.15.121:0/3809537033 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f5edc007670 con 0x7f5eec0724d0 2024-09-16T07:51:08.688 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.687+0000 7f5ef112b640 1 -- 172.21.15.121:0/3809537033 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5edc007910 con 0x7f5eec0724d0 2024-09-16T07:51:08.688 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.688+0000 7f5ef4391640 1 -- 172.21.15.121:0/3809537033 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5eec0724d0 msgr2=0x7f5eec0728e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:51:08.688 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.688+0000 7f5ef4391640 1 --2- 172.21.15.121:0/3809537033 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5eec0724d0 0x7f5eec0728e0 crc :-1 s=READY pgs=12928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:08.688 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.688+0000 7f5ef4391640 1 -- 172.21.15.121:0/3809537033 shutdown_connections 2024-09-16T07:51:08.688 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.688+0000 7f5ef4391640 1 --2- 172.21.15.121:0/3809537033 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5eec0724d0 0x7f5eec0728e0 unknown :-1 s=CLOSED pgs=12928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:08.688 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.688+0000 7f5ef4391640 1 -- 172.21.15.121:0/3809537033 >> 172.21.15.121:0/3809537033 conn(0x7f5eec0a5770 msgr2=0x7f5eec0a5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:51:08.688 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.688+0000 7f5ef4391640 1 -- 172.21.15.121:0/3809537033 shutdown_connections 2024-09-16T07:51:08.688 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.688+0000 7f5ef4391640 1 -- 172.21.15.121:0/3809537033 wait complete. 2024-09-16T07:51:08.688 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.688+0000 7f5ef4391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:08.690 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.690+0000 7f5ef4391640 1 Processor -- start 2024-09-16T07:51:08.690 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.690+0000 7f5ef4391640 1 -- start start 2024-09-16T07:51:08.691 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.691+0000 7f5ef4391640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5eec0724d0 0x7f5eec09de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:51:08.691 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.691+0000 7f5ef4391640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5eec09f9d0 con 0x7f5eec0724d0 2024-09-16T07:51:08.691 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.691+0000 7f5ef212d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5eec0724d0 0x7f5eec09de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:51:08.691 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.691+0000 7f5ef212d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5eec0724d0 0x7f5eec09de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:45252/0 (socket says 172.21.15.121:45252) 2024-09-16T07:51:08.691 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.691+0000 7f5ef212d640 1 -- 172.21.15.121:0/1932297406 learned_addr learned my addr 172.21.15.121:0/1932297406 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:51:08.691 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.691+0000 7f5ef212d640 1 -- 172.21.15.121:0/1932297406 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5eec09daa0 con 0x7f5eec0724d0 2024-09-16T07:51:08.691 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.691+0000 7f5ef212d640 1 --2- 172.21.15.121:0/1932297406 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5eec0724d0 0x7f5eec09de60 crc :-1 s=READY pgs=12929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:51:08.691 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.691+0000 7f5eeaffd640 1 -- 172.21.15.121:0/1932297406 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5edc00e040 con 0x7f5eec0724d0 2024-09-16T07:51:08.691 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.692+0000 7f5eeaffd640 1 -- 172.21.15.121:0/1932297406 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f5edc013aa0 con 0x7f5eec0724d0 2024-09-16T07:51:08.691 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.692+0000 7f5ef4391640 1 -- 172.21.15.121:0/1932297406 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5eec08f410 con 0x7f5eec0724d0 2024-09-16T07:51:08.691 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.692+0000 7f5eeaffd640 1 -- 172.21.15.121:0/1932297406 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5edc013d40 con 0x7f5eec0724d0 2024-09-16T07:51:08.692 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.692+0000 7f5ef4391640 1 -- 172.21.15.121:0/1932297406 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5eec09fc00 con 0x7f5eec0724d0 2024-09-16T07:51:08.693 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.693+0000 7f5ef4391640 1 -- 172.21.15.121:0/1932297406 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5eec074340 con 0x7f5eec0724d0 2024-09-16T07:51:08.693 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.693+0000 7f5eeaffd640 1 -- 172.21.15.121:0/1932297406 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f5edc011040 con 0x7f5eec0724d0 2024-09-16T07:51:08.693 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.693+0000 7f5eeaffd640 1 --2- 172.21.15.121:0/1932297406 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f5ed803e960 0x7f5ed8040e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:51:08.693 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.693+0000 7f5eeaffd640 1 -- 172.21.15.121:0/1932297406 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(709..709 src has 620..709) ==== 3819+0+0 (crc 0 0 0) 0x7f5edc051410 con 0x7f5eec0724d0 2024-09-16T07:51:08.693 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.693+0000 7f5ef192c640 1 --2- 172.21.15.121:0/1932297406 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f5ed803e960 0x7f5ed8040e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:51:08.693 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.694+0000 7f5ef192c640 1 --2- 172.21.15.121:0/1932297406 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f5ed803e960 0x7f5ed8040e70 crc :-1 s=READY pgs=3826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:51:08.697 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.698+0000 7f5eeaffd640 1 -- 172.21.15.121:0/1932297406 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f5edc015580 con 0x7f5eec0724d0 2024-09-16T07:51:08.874 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:08.875+0000 7f5ef4391640 1 -- 172.21.15.121:0/1932297406 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "d3276ed3-e996-4bbc-b28e-567739f7faa8", "pg_num": 12} v 0) -- 0x7f5eec06ab00 con 0x7f5eec0724d0 2024-09-16T07:51:09.629 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:09.630+0000 7f5eeaffd640 1 -- 172.21.15.121:0/1932297406 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "d3276ed3-e996-4bbc-b28e-567739f7faa8", "pg_num": 12}]=0 pool 'd3276ed3-e996-4bbc-b28e-567739f7faa8' created v710) ==== 176+0+0 (crc 0 0 0) 0x7f5edc013ea0 con 0x7f5eec0724d0 2024-09-16T07:51:09.759 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:09.760+0000 7f5ef4391640 1 -- 172.21.15.121:0/1932297406 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "d3276ed3-e996-4bbc-b28e-567739f7faa8", "pg_num": 12} v 0) -- 0x7f5eec0a0390 con 0x7f5eec0724d0 2024-09-16T07:51:09.759 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:09.761+0000 7f5eeaffd640 1 -- 172.21.15.121:0/1932297406 <== mon.0 v2:172.21.15.121:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "d3276ed3-e996-4bbc-b28e-567739f7faa8", "pg_num": 12}]=0 pool 'd3276ed3-e996-4bbc-b28e-567739f7faa8' already exists v710) ==== 183+0+0 (crc 0 0 0) 0x7f5edc010280 con 0x7f5eec0724d0 2024-09-16T07:51:09.760 INFO:tasks.workunit.client.0.smithi121.stderr:pool 'd3276ed3-e996-4bbc-b28e-567739f7faa8' already exists 2024-09-16T07:51:09.762 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:09.763+0000 7f5ef4391640 1 -- 172.21.15.121:0/1932297406 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f5ed803e960 msgr2=0x7f5ed8040e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:51:09.762 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:09.763+0000 7f5ef4391640 1 --2- 172.21.15.121:0/1932297406 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f5ed803e960 0x7f5ed8040e70 crc :-1 s=READY pgs=3826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:09.762 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:09.763+0000 7f5ef4391640 1 -- 172.21.15.121:0/1932297406 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5eec0724d0 msgr2=0x7f5eec09de60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:51:09.762 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:09.763+0000 7f5ef4391640 1 --2- 172.21.15.121:0/1932297406 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5eec0724d0 0x7f5eec09de60 crc :-1 s=READY pgs=12929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:09.762 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:09.763+0000 7f5ef4391640 1 -- 172.21.15.121:0/1932297406 shutdown_connections 2024-09-16T07:51:09.762 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:09.763+0000 7f5ef4391640 1 --2- 172.21.15.121:0/1932297406 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f5ed803e960 0x7f5ed8040e70 unknown :-1 s=CLOSED pgs=3826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:09.762 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:09.763+0000 7f5ef4391640 1 --2- 172.21.15.121:0/1932297406 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5eec0724d0 0x7f5eec09de60 unknown :-1 s=CLOSED pgs=12929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:09.762 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:09.763+0000 7f5ef4391640 1 -- 172.21.15.121:0/1932297406 >> 172.21.15.121:0/1932297406 conn(0x7f5eec0a5770 msgr2=0x7f5eec092a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:51:09.762 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:09.763+0000 7f5ef4391640 1 -- 172.21.15.121:0/1932297406 shutdown_connections 2024-09-16T07:51:09.763 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:09.763+0000 7f5ef4391640 1 -- 172.21.15.121:0/1932297406 wait complete. 2024-09-16T07:51:09.772 INFO:tasks.workunit.client.0.smithi121.stderr:+ ceph osd pool application enable d3276ed3-e996-4bbc-b28e-567739f7faa8 rados 2024-09-16T07:51:09.864 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:09.857+0000 7fec65391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:09.865 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:09.866+0000 7fec65391640 1 Processor -- start 2024-09-16T07:51:09.865 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:09.867+0000 7fec65391640 1 -- start start 2024-09-16T07:51:09.867 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:09.868+0000 7fec65391640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fec6009ed30 0x7fec601362c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:51:09.867 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:09.868+0000 7fec65391640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec6009fd50 con 0x7fec60136800 2024-09-16T07:51:09.867 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:09.868+0000 7fec65391640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fec6009fa40 con 0x7fec6009ed30 2024-09-16T07:51:09.867 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:09.868+0000 7fec5effd640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fec6009ed30 0x7fec601362c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:51:09.868 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:09.868+0000 7fec567fc640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fec60136800 0x7fec6006ecc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:42738/0 (socket says 172.21.15.121:42738) 2024-09-16T07:51:09.868 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:09.868+0000 7fec567fc640 1 -- 172.21.15.121:0/1030646964 learned_addr learned my addr 172.21.15.121:0/1030646964 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-16T07:51:09.868 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:09.868+0000 7fec5effd640 1 -- 172.21.15.121:0/1030646964 >> v1:172.21.15.121:6789/0 conn(0x7fec60136800 legacy=0x7fec6006ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:51:09.868 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:09.868+0000 7fec5effd640 1 -- 172.21.15.121:0/1030646964 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec6009ffe0 con 0x7fec6009ed30 2024-09-16T07:51:09.868 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:09.868+0000 7fec5e7fc640 1 -- 172.21.15.121:0/1030646964 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3743494299 0 0) 0x7fec6009fd50 con 0x7fec60136800 2024-09-16T07:51:09.868 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:09.868+0000 7fec5effd640 1 --2- 172.21.15.121:0/1030646964 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec6009ed30 0x7fec601362c0 crc :-1 s=READY pgs=12931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a11f0065f02cc04c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:51:09.868 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:09.868+0000 7fec5e7fc640 1 -- 172.21.15.121:0/1030646964 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fec50009d90 con 0x7fec6009ed30 2024-09-16T07:51:09.868 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:09.868+0000 7fec5e7fc640 1 -- 172.21.15.121:0/1030646964 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fec5000e230 con 0x7fec6009ed30 2024-09-16T07:51:09.868 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:09.868+0000 7fec5e7fc640 1 -- 172.21.15.121:0/1030646964 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fec5000e4d0 con 0x7fec6009ed30 2024-09-16T07:51:09.869 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:09.869+0000 7fec65391640 1 -- 172.21.15.121:0/1030646964 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec6009ed30 msgr2=0x7fec601362c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:51:09.869 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:09.869+0000 7fec65391640 1 --2- 172.21.15.121:0/1030646964 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec6009ed30 0x7fec601362c0 crc :-1 s=READY pgs=12931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:09.869 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:09.869+0000 7fec65391640 1 -- 172.21.15.121:0/1030646964 shutdown_connections 2024-09-16T07:51:09.869 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:09.869+0000 7fec65391640 1 --2- 172.21.15.121:0/1030646964 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec6009ed30 0x7fec601362c0 unknown :-1 s=CLOSED pgs=12931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:09.869 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:09.869+0000 7fec65391640 1 -- 172.21.15.121:0/1030646964 >> 172.21.15.121:0/1030646964 conn(0x7fec600a5350 msgr2=0x7fec600a5760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:51:09.869 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:09.869+0000 7fec65391640 1 -- 172.21.15.121:0/1030646964 shutdown_connections 2024-09-16T07:51:09.869 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:09.869+0000 7fec65391640 1 -- 172.21.15.121:0/1030646964 wait complete. 2024-09-16T07:51:09.870 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:09.870+0000 7fec65391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:09.870 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:09.871+0000 7fec65391640 1 Processor -- start 2024-09-16T07:51:09.870 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:09.871+0000 7fec65391640 1 -- start start 2024-09-16T07:51:09.872 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:09.872+0000 7fec65391640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec6009ed30 0x7fec60120a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:51:09.872 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:09.872+0000 7fec65391640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fec60122cf0 con 0x7fec6009ed30 2024-09-16T07:51:09.872 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:09.872+0000 7fec5effd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec6009ed30 0x7fec60120a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:51:09.872 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:09.872+0000 7fec5effd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec6009ed30 0x7fec60120a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:45274/0 (socket says 172.21.15.121:45274) 2024-09-16T07:51:09.873 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:09.872+0000 7fec5effd640 1 -- 172.21.15.121:0/2079779898 learned_addr learned my addr 172.21.15.121:0/2079779898 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:51:09.873 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:09.872+0000 7fec5effd640 1 -- 172.21.15.121:0/2079779898 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec60124a10 con 0x7fec6009ed30 2024-09-16T07:51:09.873 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:09.873+0000 7fec5effd640 1 --2- 172.21.15.121:0/2079779898 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec6009ed30 0x7fec60120a00 crc :-1 s=READY pgs=12932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:51:09.873 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:09.873+0000 7fec57fff640 1 -- 172.21.15.121:0/2079779898 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fec50013610 con 0x7fec6009ed30 2024-09-16T07:51:09.873 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:09.873+0000 7fec57fff640 1 -- 172.21.15.121:0/2079779898 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fec50013770 con 0x7fec6009ed30 2024-09-16T07:51:09.873 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:09.873+0000 7fec57fff640 1 -- 172.21.15.121:0/2079779898 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fec50013a10 con 0x7fec6009ed30 2024-09-16T07:51:09.873 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:09.873+0000 7fec65391640 1 -- 172.21.15.121:0/2079779898 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec60121db0 con 0x7fec6009ed30 2024-09-16T07:51:09.873 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:09.873+0000 7fec65391640 1 -- 172.21.15.121:0/2079779898 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec60134cd0 con 0x7fec6009ed30 2024-09-16T07:51:09.874 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:09.874+0000 7fec65391640 1 -- 172.21.15.121:0/2079779898 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec601362c0 con 0x7fec6009ed30 2024-09-16T07:51:09.874 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:09.874+0000 7fec57fff640 1 -- 172.21.15.121:0/2079779898 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fec50013bc0 con 0x7fec6009ed30 2024-09-16T07:51:09.874 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:09.874+0000 7fec57fff640 1 --2- 172.21.15.121:0/2079779898 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fec4003e930 0x7fec40040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:51:09.874 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:09.874+0000 7fec57fff640 1 -- 172.21.15.121:0/2079779898 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(710..710 src has 620..710) ==== 4194+0+0 (crc 0 0 0) 0x7fec50018040 con 0x7fec6009ed30 2024-09-16T07:51:09.874 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:09.874+0000 7fec567fc640 1 --2- 172.21.15.121:0/2079779898 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fec4003e930 0x7fec40040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:51:09.874 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:09.875+0000 7fec567fc640 1 --2- 172.21.15.121:0/2079779898 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fec4003e930 0x7fec40040e40 crc :-1 s=READY pgs=3827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:51:09.878 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:09.880+0000 7fec57fff640 1 -- 172.21.15.121:0/2079779898 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fec50011380 con 0x7fec6009ed30 2024-09-16T07:51:10.055 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:10.056+0000 7fec65391640 1 -- 172.21.15.121:0/2079779898 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "d3276ed3-e996-4bbc-b28e-567739f7faa8", "app": "rados"} v 0) -- 0x7fec60076080 con 0x7fec6009ed30 2024-09-16T07:51:10.630 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:10.631+0000 7fec57fff640 1 -- 172.21.15.121:0/2079779898 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "d3276ed3-e996-4bbc-b28e-567739f7faa8", "app": "rados"}]=0 enabled application 'rados' on pool 'd3276ed3-e996-4bbc-b28e-567739f7faa8' v711) ==== 213+0+0 (crc 0 0 0) 0x7fec50018a40 con 0x7fec6009ed30 2024-09-16T07:51:10.794 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:10.795+0000 7fec65391640 1 -- 172.21.15.121:0/2079779898 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "d3276ed3-e996-4bbc-b28e-567739f7faa8", "app": "rados"} v 0) -- 0x7fec60123260 con 0x7fec6009ed30 2024-09-16T07:51:11.640 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:11.641+0000 7fec57fff640 1 -- 172.21.15.121:0/2079779898 <== mon.0 v2:172.21.15.121:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "d3276ed3-e996-4bbc-b28e-567739f7faa8", "app": "rados"}]=0 enabled application 'rados' on pool 'd3276ed3-e996-4bbc-b28e-567739f7faa8' v712) ==== 213+0+0 (crc 0 0 0) 0x7fec50017190 con 0x7fec6009ed30 2024-09-16T07:51:11.640 INFO:tasks.workunit.client.0.smithi121.stderr:enabled application 'rados' on pool 'd3276ed3-e996-4bbc-b28e-567739f7faa8' 2024-09-16T07:51:11.643 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:11.644+0000 7fec65391640 1 -- 172.21.15.121:0/2079779898 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fec4003e930 msgr2=0x7fec40040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:51:11.644 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:11.644+0000 7fec65391640 1 --2- 172.21.15.121:0/2079779898 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fec4003e930 0x7fec40040e40 crc :-1 s=READY pgs=3827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:11.644 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:11.644+0000 7fec65391640 1 -- 172.21.15.121:0/2079779898 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec6009ed30 msgr2=0x7fec60120a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:51:11.644 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:11.644+0000 7fec65391640 1 --2- 172.21.15.121:0/2079779898 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec6009ed30 0x7fec60120a00 crc :-1 s=READY pgs=12932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:11.644 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:11.644+0000 7fec65391640 1 -- 172.21.15.121:0/2079779898 shutdown_connections 2024-09-16T07:51:11.644 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:11.644+0000 7fec65391640 1 --2- 172.21.15.121:0/2079779898 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fec4003e930 0x7fec40040e40 unknown :-1 s=CLOSED pgs=3827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:11.644 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:11.644+0000 7fec65391640 1 --2- 172.21.15.121:0/2079779898 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec6009ed30 0x7fec60120a00 unknown :-1 s=CLOSED pgs=12932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:11.644 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:11.644+0000 7fec65391640 1 -- 172.21.15.121:0/2079779898 >> 172.21.15.121:0/2079779898 conn(0x7fec600a5350 msgr2=0x7fec600a3260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:51:11.644 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:11.644+0000 7fec65391640 1 -- 172.21.15.121:0/2079779898 shutdown_connections 2024-09-16T07:51:11.645 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:11.644+0000 7fec65391640 1 -- 172.21.15.121:0/2079779898 wait complete. 2024-09-16T07:51:11.658 INFO:tasks.workunit.client.0.smithi121.stderr:+ ceph osd pool set-quota d3276ed3-e996-4bbc-b28e-567739f7faa8 max_objects 10 2024-09-16T07:51:11.763 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:11.755+0000 7f4003991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:11.764 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:11.765+0000 7f4003991640 1 Processor -- start 2024-09-16T07:51:11.764 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:11.765+0000 7f4003991640 1 -- start start 2024-09-16T07:51:11.768 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:11.766+0000 7f4003991640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f3ffc1355f0 0x7f3ffc137a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:51:11.769 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:11.766+0000 7f4003991640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ffc06ea50 con 0x7f3ffc09c830 2024-09-16T07:51:11.769 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:11.766+0000 7f4003991640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f3ffc09d350 con 0x7f3ffc1355f0 2024-09-16T07:51:11.769 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:11.766+0000 7f4000f2c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f3ffc1355f0 0x7f3ffc137a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:51:11.769 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:11.766+0000 7f4000f2c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f3ffc1355f0 0x7f3ffc137a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:45286/0 (socket says 172.21.15.121:45286) 2024-09-16T07:51:11.769 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:11.766+0000 7f400172d640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f3ffc09c830 0x7f3ffc09cc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:42746/0 (socket says 172.21.15.121:42746) 2024-09-16T07:51:11.769 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:11.766+0000 7f4000f2c640 1 -- 172.21.15.121:0/114899477 learned_addr learned my addr 172.21.15.121:0/114899477 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:51:11.770 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:11.767+0000 7f4000f2c640 1 -- 172.21.15.121:0/114899477 >> v1:172.21.15.121:6789/0 conn(0x7f3ffc09c830 legacy=0x7f3ffc09cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:51:11.770 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:11.767+0000 7f3ff3fff640 1 -- 172.21.15.121:0/114899477 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2680169435 0 0) 0x7f3ffc06ea50 con 0x7f3ffc09c830 2024-09-16T07:51:11.770 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:11.767+0000 7f4000f2c640 1 -- 172.21.15.121:0/114899477 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ffc09d6e0 con 0x7f3ffc1355f0 2024-09-16T07:51:11.770 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:11.767+0000 7f4000f2c640 1 --2- 172.21.15.121:0/114899477 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ffc1355f0 0x7f3ffc137a10 crc :-1 s=READY pgs=12934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67da667bc79484f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:51:11.770 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:11.767+0000 7f3ff3fff640 1 -- 172.21.15.121:0/114899477 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3fec00add0 con 0x7f3ffc1355f0 2024-09-16T07:51:11.771 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:11.767+0000 7f3ff3fff640 1 -- 172.21.15.121:0/114899477 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f3fec00f340 con 0x7f3ffc1355f0 2024-09-16T07:51:11.771 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:11.767+0000 7f3ff3fff640 1 -- 172.21.15.121:0/114899477 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3fec00f5e0 con 0x7f3ffc1355f0 2024-09-16T07:51:11.771 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:11.768+0000 7f4003991640 1 -- 172.21.15.121:0/114899477 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ffc1355f0 msgr2=0x7f3ffc137a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:51:11.771 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:11.768+0000 7f4003991640 1 --2- 172.21.15.121:0/114899477 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ffc1355f0 0x7f3ffc137a10 crc :-1 s=READY pgs=12934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:11.771 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:11.768+0000 7f4003991640 1 -- 172.21.15.121:0/114899477 shutdown_connections 2024-09-16T07:51:11.771 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:11.768+0000 7f4003991640 1 --2- 172.21.15.121:0/114899477 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ffc1355f0 0x7f3ffc137a10 unknown :-1 s=CLOSED pgs=12934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:11.772 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:11.768+0000 7f4003991640 1 -- 172.21.15.121:0/114899477 >> 172.21.15.121:0/114899477 conn(0x7f3ffc0a2000 msgr2=0x7f3ffc0a2410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:51:11.772 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:11.768+0000 7f4003991640 1 -- 172.21.15.121:0/114899477 shutdown_connections 2024-09-16T07:51:11.772 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:11.768+0000 7f4003991640 1 -- 172.21.15.121:0/114899477 wait complete. 2024-09-16T07:51:11.772 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:11.768+0000 7f4003991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:11.772 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:11.769+0000 7f4003991640 1 Processor -- start 2024-09-16T07:51:11.772 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:11.769+0000 7f4003991640 1 -- start start 2024-09-16T07:51:11.776 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:11.770+0000 7f4003991640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ffc09c830 0x7f3ffc12b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:51:11.776 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:11.770+0000 7f4003991640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3ffc12d180 con 0x7f3ffc09c830 2024-09-16T07:51:11.776 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:11.771+0000 7f400172d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ffc09c830 0x7f3ffc12b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:51:11.776 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:11.771+0000 7f400172d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ffc09c830 0x7f3ffc12b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:45296/0 (socket says 172.21.15.121:45296) 2024-09-16T07:51:11.776 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:11.771+0000 7f400172d640 1 -- 172.21.15.121:0/3303211920 learned_addr learned my addr 172.21.15.121:0/3303211920 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:51:11.776 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:11.771+0000 7f400172d640 1 -- 172.21.15.121:0/3303211920 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ffc12f670 con 0x7f3ffc09c830 2024-09-16T07:51:11.777 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:11.771+0000 7f400172d640 1 --2- 172.21.15.121:0/3303211920 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ffc09c830 0x7f3ffc12b980 crc :-1 s=READY pgs=12935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:51:11.777 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:11.771+0000 7f3ff1ffb640 1 -- 172.21.15.121:0/3303211920 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3ff8007120 con 0x7f3ffc09c830 2024-09-16T07:51:11.777 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:11.771+0000 7f3ff1ffb640 1 -- 172.21.15.121:0/3303211920 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f3ff8007280 con 0x7f3ffc09c830 2024-09-16T07:51:11.777 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:11.771+0000 7f4003991640 1 -- 172.21.15.121:0/3303211920 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ffc12e930 con 0x7f3ffc09c830 2024-09-16T07:51:11.777 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:11.771+0000 7f3ff1ffb640 1 -- 172.21.15.121:0/3303211920 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3ff8007520 con 0x7f3ffc09c830 2024-09-16T07:51:11.777 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:11.771+0000 7f4003991640 1 -- 172.21.15.121:0/3303211920 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ffc12f390 con 0x7f3ffc09c830 2024-09-16T07:51:11.777 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:11.772+0000 7f3ff1ffb640 1 -- 172.21.15.121:0/3303211920 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f3ff80076d0 con 0x7f3ffc09c830 2024-09-16T07:51:11.777 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:11.772+0000 7f4003991640 1 -- 172.21.15.121:0/3303211920 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ffc06e540 con 0x7f3ffc09c830 2024-09-16T07:51:11.778 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:11.772+0000 7f3ff1ffb640 1 --2- 172.21.15.121:0/3303211920 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f3fe003e930 0x7f3fe0040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:51:11.778 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:11.773+0000 7f3ff1ffb640 1 -- 172.21.15.121:0/3303211920 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(712..712 src has 620..712) ==== 4207+0+0 (crc 0 0 0) 0x7f3ff80531b0 con 0x7f3ffc09c830 2024-09-16T07:51:11.778 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:11.773+0000 7f4000f2c640 1 --2- 172.21.15.121:0/3303211920 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f3fe003e930 0x7f3fe0040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:51:11.778 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:11.773+0000 7f4000f2c640 1 --2- 172.21.15.121:0/3303211920 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f3fe003e930 0x7f3fe0040e40 crc :-1 s=READY pgs=3828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:51:11.778 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:11.778+0000 7f3ff1ffb640 1 -- 172.21.15.121:0/3303211920 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f3ff80103d0 con 0x7f3ffc09c830 2024-09-16T07:51:11.953 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:11.954+0000 7f4003991640 1 -- 172.21.15.121:0/3303211920 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "d3276ed3-e996-4bbc-b28e-567739f7faa8", "field": "max_objects", "val": "10"} v 0) -- 0x7f3ffc12eb70 con 0x7f3ffc09c830 2024-09-16T07:51:12.487 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:12.488+0000 7f3ff1ffb640 1 -- 172.21.15.121:0/3303211920 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "d3276ed3-e996-4bbc-b28e-567739f7faa8", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool d3276ed3-e996-4bbc-b28e-567739f7faa8 v713) ==== 223+0+0 (crc 0 0 0) 0x7f3ff8006940 con 0x7f3ffc09c830 2024-09-16T07:51:12.620 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:12.621+0000 7f4003991640 1 -- 172.21.15.121:0/3303211920 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "d3276ed3-e996-4bbc-b28e-567739f7faa8", "field": "max_objects", "val": "10"} v 0) -- 0x7f3ffc0008d0 con 0x7f3ffc09c830 2024-09-16T07:51:13.492 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:13.492+0000 7f3ff1ffb640 1 -- 172.21.15.121:0/3303211920 <== mon.0 v2:172.21.15.121:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "d3276ed3-e996-4bbc-b28e-567739f7faa8", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool d3276ed3-e996-4bbc-b28e-567739f7faa8 v714) ==== 223+0+0 (crc 0 0 0) 0x7f3ff8005040 con 0x7f3ffc09c830 2024-09-16T07:51:13.492 INFO:tasks.workunit.client.0.smithi121.stderr:set-quota max_objects = 10 for pool d3276ed3-e996-4bbc-b28e-567739f7faa8 2024-09-16T07:51:13.495 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:13.496+0000 7f4003991640 1 -- 172.21.15.121:0/3303211920 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f3fe003e930 msgr2=0x7f3fe0040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:51:13.495 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:13.496+0000 7f4003991640 1 --2- 172.21.15.121:0/3303211920 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f3fe003e930 0x7f3fe0040e40 crc :-1 s=READY pgs=3828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:13.495 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:13.496+0000 7f4003991640 1 -- 172.21.15.121:0/3303211920 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ffc09c830 msgr2=0x7f3ffc12b980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:51:13.495 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:13.496+0000 7f4003991640 1 --2- 172.21.15.121:0/3303211920 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ffc09c830 0x7f3ffc12b980 crc :-1 s=READY pgs=12935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:13.495 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:13.496+0000 7f4003991640 1 -- 172.21.15.121:0/3303211920 shutdown_connections 2024-09-16T07:51:13.495 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:13.496+0000 7f4003991640 1 --2- 172.21.15.121:0/3303211920 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f3fe003e930 0x7f3fe0040e40 crc :-1 s=CLOSED pgs=3828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:13.495 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:13.496+0000 7f4003991640 1 --2- 172.21.15.121:0/3303211920 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ffc09c830 0x7f3ffc12b980 unknown :-1 s=CLOSED pgs=12935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:13.495 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:13.496+0000 7f4003991640 1 -- 172.21.15.121:0/3303211920 >> 172.21.15.121:0/3303211920 conn(0x7f3ffc0a2000 msgr2=0x7f3ffc0a0230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:51:13.495 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:13.496+0000 7f4003991640 1 -- 172.21.15.121:0/3303211920 shutdown_connections 2024-09-16T07:51:13.495 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:13.496+0000 7f4003991640 1 -- 172.21.15.121:0/3303211920 wait complete. 2024-09-16T07:51:13.510 INFO:tasks.workunit.client.0.smithi121.stderr:+ sleep 30 2024-09-16T07:51:43.512 INFO:tasks.workunit.client.0.smithi121.stderr:++ seq 1 10 2024-09-16T07:51:43.513 INFO:tasks.workunit.client.0.smithi121.stderr:+ for f in `seq 1 10` 2024-09-16T07:51:43.513 INFO:tasks.workunit.client.0.smithi121.stderr:+ rados -p d3276ed3-e996-4bbc-b28e-567739f7faa8 put obj1 /etc/passwd 2024-09-16T07:51:43.557 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.558+0000 7fc3470f1ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:43.563 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.564+0000 7fc3470f1ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:43.563 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.564+0000 7fc3470f1ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:43.563 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.564+0000 7fc3470f1ec0 1 Processor -- start 2024-09-16T07:51:43.563 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.565+0000 7fc3470f1ec0 1 -- start start 2024-09-16T07:51:43.565 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.565+0000 7fc3470f1ec0 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x24cefc0 0x25f51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:51:43.565 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.566+0000 7fc3470f1ec0 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x243b520 con 0x24cefc0 2024-09-16T07:51:43.565 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.566+0000 7fc33f43f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x24cefc0 0x25f51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:51:43.565 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.566+0000 7fc33f43f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x24cefc0 0x25f51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:51874/0 (socket says 172.21.15.121:51874) 2024-09-16T07:51:43.565 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.566+0000 7fc33f43f640 1 -- 172.21.15.121:0/3879506336 learned_addr learned my addr 172.21.15.121:0/3879506336 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:51:43.565 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.566+0000 7fc33f43f640 1 -- 172.21.15.121:0/3879506336 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x23d7e10 con 0x24cefc0 2024-09-16T07:51:43.565 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.566+0000 7fc33f43f640 1 --2- 172.21.15.121:0/3879506336 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x24cefc0 0x25f51b0 crc :-1 s=READY pgs=12938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=852afd657e1a83fb server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:51:43.566 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.566+0000 7fc33dc3c640 1 -- 172.21.15.121:0/3879506336 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc32800b580 con 0x24cefc0 2024-09-16T07:51:43.566 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.566+0000 7fc33dc3c640 1 -- 172.21.15.121:0/3879506336 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc32800b6e0 con 0x24cefc0 2024-09-16T07:51:43.566 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.566+0000 7fc33dc3c640 1 -- 172.21.15.121:0/3879506336 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc32800b980 con 0x24cefc0 2024-09-16T07:51:43.567 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.567+0000 7fc3470f1ec0 1 -- 172.21.15.121:0/3879506336 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x24cefc0 msgr2=0x25f51b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:51:43.567 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.567+0000 7fc3470f1ec0 1 --2- 172.21.15.121:0/3879506336 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x24cefc0 0x25f51b0 crc :-1 s=READY pgs=12938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:43.567 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.567+0000 7fc3470f1ec0 1 -- 172.21.15.121:0/3879506336 shutdown_connections 2024-09-16T07:51:43.567 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.567+0000 7fc3470f1ec0 1 --2- 172.21.15.121:0/3879506336 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x24cefc0 0x25f51b0 unknown :-1 s=CLOSED pgs=12938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:43.567 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.567+0000 7fc3470f1ec0 1 -- 172.21.15.121:0/3879506336 >> 172.21.15.121:0/3879506336 conn(0x23fb770 msgr2=0x24d0700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:51:43.567 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.567+0000 7fc3470f1ec0 1 -- 172.21.15.121:0/3879506336 shutdown_connections 2024-09-16T07:51:43.567 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.567+0000 7fc3470f1ec0 1 -- 172.21.15.121:0/3879506336 wait complete. 2024-09-16T07:51:43.567 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.568+0000 7fc3470f1ec0 1 Processor -- start 2024-09-16T07:51:43.567 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.568+0000 7fc3470f1ec0 1 -- start start 2024-09-16T07:51:43.569 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.569+0000 7fc3470f1ec0 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x24cefc0 0x25dc7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:51:43.569 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.569+0000 7fc3470f1ec0 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x2439280 con 0x24cefc0 2024-09-16T07:51:43.569 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.569+0000 7fc33f43f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x24cefc0 0x25dc7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:51:43.569 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.569+0000 7fc33f43f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x24cefc0 0x25dc7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:51882/0 (socket says 172.21.15.121:51882) 2024-09-16T07:51:43.569 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.569+0000 7fc33f43f640 1 -- 172.21.15.121:0/1940657291 learned_addr learned my addr 172.21.15.121:0/1940657291 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:51:43.569 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.569+0000 7fc33f43f640 1 -- 172.21.15.121:0/1940657291 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x23c9920 con 0x24cefc0 2024-09-16T07:51:43.569 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.569+0000 7fc33f43f640 1 --2- 172.21.15.121:0/1940657291 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x24cefc0 0x25dc7c0 crc :-1 s=READY pgs=12939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:51:43.569 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.569+0000 7fc33cc3a640 1 -- 172.21.15.121:0/1940657291 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc328012b10 con 0x24cefc0 2024-09-16T07:51:43.569 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.569+0000 7fc33cc3a640 1 -- 172.21.15.121:0/1940657291 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc328005040 con 0x24cefc0 2024-09-16T07:51:43.570 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.569+0000 7fc3470f1ec0 1 -- 172.21.15.121:0/1940657291 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x23c9380 con 0x24cefc0 2024-09-16T07:51:43.570 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.569+0000 7fc33cc3a640 1 -- 172.21.15.121:0/1940657291 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc328012da0 con 0x24cefc0 2024-09-16T07:51:43.570 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.569+0000 7fc3470f1ec0 1 -- 172.21.15.121:0/1940657291 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x25dda10 con 0x24cefc0 2024-09-16T07:51:43.570 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.570+0000 7fc33cc3a640 1 -- 172.21.15.121:0/1940657291 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fc32800d040 con 0x24cefc0 2024-09-16T07:51:43.571 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.571+0000 7fc33cc3a640 1 --2- 172.21.15.121:0/1940657291 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fc32403d1c0 0x7fc32403f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:51:43.571 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.571+0000 7fc33cc3a640 1 -- 172.21.15.121:0/1940657291 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(715..715 src has 620..715) ==== 4207+0+0 (crc 0 0 0) 0x7fc32800a040 con 0x24cefc0 2024-09-16T07:51:43.571 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.571+0000 7fc3470f1ec0 1 --2- 172.21.15.121:0/1940657291 >> v2:172.21.15.172:6808/3418488586 conn(0x24d7300 0x25dd210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:51:43.571 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.571+0000 7fc3470f1ec0 1 -- 172.21.15.121:0/1940657291 --> v2:172.21.15.172:6808/3418488586 -- osd_op(unknown.0.0:1 200.7 200:ff7b1f36:::obj1:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e715) -- 0x2a02e00 con 0x24d7300 2024-09-16T07:51:43.571 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.571+0000 7fc33ec3e640 1 --2- 172.21.15.121:0/1940657291 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fc32403d1c0 0x7fc32403f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:51:43.571 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.572+0000 7fc33ec3e640 1 --2- 172.21.15.121:0/1940657291 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fc32403d1c0 0x7fc32403f6d0 crc :-1 s=READY pgs=3829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:51:43.571 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.572+0000 7fc33fc40640 1 --2- 172.21.15.121:0/1940657291 >> v2:172.21.15.172:6808/3418488586 conn(0x24d7300 0x25dd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T07:51:43.575 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.577+0000 7fc33fc40640 1 --2- 172.21.15.121:0/1940657291 >> v2:172.21.15.172:6808/3418488586 conn(0x24d7300 0x25dd210 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:51:43.593 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.594+0000 7fc33fc40640 1 -- 172.21.15.121:0/1940657291 <== osd.3 v2:172.21.15.172:6808/3418488586 1 ==== osd_op_reply(1 obj1 [writefull 0~12875] v715'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fc33000a430 con 0x24d7300 2024-09-16T07:51:43.593 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.594+0000 7fc3470f1ec0 1 -- 172.21.15.121:0/1940657291 >> v2:172.21.15.172:6808/3418488586 conn(0x24d7300 msgr2=0x25dd210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:51:43.593 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.594+0000 7fc3470f1ec0 1 --2- 172.21.15.121:0/1940657291 >> v2:172.21.15.172:6808/3418488586 conn(0x24d7300 0x25dd210 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:43.593 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.594+0000 7fc3470f1ec0 1 -- 172.21.15.121:0/1940657291 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fc32403d1c0 msgr2=0x7fc32403f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:51:43.593 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.594+0000 7fc3470f1ec0 1 --2- 172.21.15.121:0/1940657291 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fc32403d1c0 0x7fc32403f6d0 crc :-1 s=READY pgs=3829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:43.593 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.594+0000 7fc3470f1ec0 1 -- 172.21.15.121:0/1940657291 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x24cefc0 msgr2=0x25dc7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:51:43.593 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.594+0000 7fc3470f1ec0 1 --2- 172.21.15.121:0/1940657291 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x24cefc0 0x25dc7c0 crc :-1 s=READY pgs=12939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:43.593 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.594+0000 7fc3470f1ec0 1 -- 172.21.15.121:0/1940657291 shutdown_connections 2024-09-16T07:51:43.594 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.594+0000 7fc3470f1ec0 1 --2- 172.21.15.121:0/1940657291 >> v2:172.21.15.172:6808/3418488586 conn(0x24d7300 0x25dd210 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:43.594 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.594+0000 7fc3470f1ec0 1 --2- 172.21.15.121:0/1940657291 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fc32403d1c0 0x7fc32403f6d0 unknown :-1 s=CLOSED pgs=3829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:43.594 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.594+0000 7fc3470f1ec0 1 --2- 172.21.15.121:0/1940657291 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x24cefc0 0x25dc7c0 unknown :-1 s=CLOSED pgs=12939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:43.594 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.594+0000 7fc3470f1ec0 1 -- 172.21.15.121:0/1940657291 >> 172.21.15.121:0/1940657291 conn(0x23fb770 msgr2=0x24aad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:51:43.594 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.594+0000 7fc3470f1ec0 1 -- 172.21.15.121:0/1940657291 shutdown_connections 2024-09-16T07:51:43.594 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.594+0000 7fc3470f1ec0 1 -- 172.21.15.121:0/1940657291 wait complete. 2024-09-16T07:51:43.595 INFO:tasks.workunit.client.0.smithi121.stderr:+ for f in `seq 1 10` 2024-09-16T07:51:43.595 INFO:tasks.workunit.client.0.smithi121.stderr:+ rados -p d3276ed3-e996-4bbc-b28e-567739f7faa8 put obj2 /etc/passwd 2024-09-16T07:51:43.632 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.633+0000 7efe458edec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:43.637 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.639+0000 7efe458edec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:43.637 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.639+0000 7efe458edec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:43.638 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.639+0000 7efe458edec0 1 Processor -- start 2024-09-16T07:51:43.638 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.639+0000 7efe458edec0 1 -- start start 2024-09-16T07:51:43.640 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.640+0000 7efe458edec0 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xaf8e30 0xc176c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:51:43.640 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.640+0000 7efe458edec0 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0xa63520 con 0xaf8e30 2024-09-16T07:51:43.640 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.640+0000 7efe3dd9b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xaf8e30 0xc176c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:51:43.640 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.641+0000 7efe3dd9b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xaf8e30 0xc176c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:51908/0 (socket says 172.21.15.121:51908) 2024-09-16T07:51:43.640 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.641+0000 7efe3dd9b640 1 -- 172.21.15.121:0/4268731848 learned_addr learned my addr 172.21.15.121:0/4268731848 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:51:43.640 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.641+0000 7efe3dd9b640 1 -- 172.21.15.121:0/4268731848 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x9ffe10 con 0xaf8e30 2024-09-16T07:51:43.640 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.641+0000 7efe3dd9b640 1 --2- 172.21.15.121:0/4268731848 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xaf8e30 0xc176c0 crc :-1 s=READY pgs=12942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19cdd112477b42f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:51:43.640 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.641+0000 7efe377fe640 1 -- 172.21.15.121:0/4268731848 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7efe2802db90 con 0xaf8e30 2024-09-16T07:51:43.640 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.641+0000 7efe377fe640 1 -- 172.21.15.121:0/4268731848 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7efe2802dcf0 con 0xaf8e30 2024-09-16T07:51:43.640 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.641+0000 7efe377fe640 1 -- 172.21.15.121:0/4268731848 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7efe280374a0 con 0xaf8e30 2024-09-16T07:51:43.641 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.642+0000 7efe458edec0 1 -- 172.21.15.121:0/4268731848 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xaf8e30 msgr2=0xc176c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:51:43.642 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.642+0000 7efe458edec0 1 --2- 172.21.15.121:0/4268731848 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xaf8e30 0xc176c0 crc :-1 s=READY pgs=12942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:43.642 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.642+0000 7efe458edec0 1 -- 172.21.15.121:0/4268731848 shutdown_connections 2024-09-16T07:51:43.642 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.642+0000 7efe458edec0 1 --2- 172.21.15.121:0/4268731848 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xaf8e30 0xc176c0 unknown :-1 s=CLOSED pgs=12942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:43.642 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.642+0000 7efe458edec0 1 -- 172.21.15.121:0/4268731848 >> 172.21.15.121:0/4268731848 conn(0xa23770 msgr2=0xb01370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:51:43.642 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.642+0000 7efe458edec0 1 -- 172.21.15.121:0/4268731848 shutdown_connections 2024-09-16T07:51:43.642 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.642+0000 7efe458edec0 1 -- 172.21.15.121:0/4268731848 wait complete. 2024-09-16T07:51:43.642 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.642+0000 7efe458edec0 1 Processor -- start 2024-09-16T07:51:43.642 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.642+0000 7efe458edec0 1 -- start start 2024-09-16T07:51:43.643 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.643+0000 7efe458edec0 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xaf8e30 0xafaee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:51:43.644 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.643+0000 7efe458edec0 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0xa61280 con 0xaf8e30 2024-09-16T07:51:43.644 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.644+0000 7efe3dd9b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xaf8e30 0xafaee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:51:43.644 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.644+0000 7efe3dd9b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xaf8e30 0xafaee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:51918/0 (socket says 172.21.15.121:51918) 2024-09-16T07:51:43.644 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.644+0000 7efe3dd9b640 1 -- 172.21.15.121:0/130096837 learned_addr learned my addr 172.21.15.121:0/130096837 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:51:43.644 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.644+0000 7efe3dd9b640 1 -- 172.21.15.121:0/130096837 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x9f1920 con 0xaf8e30 2024-09-16T07:51:43.644 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.644+0000 7efe3dd9b640 1 --2- 172.21.15.121:0/130096837 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xaf8e30 0xafaee0 crc :-1 s=READY pgs=12943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:51:43.644 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.644+0000 7efe367fc640 1 -- 172.21.15.121:0/130096837 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7efe2803e040 con 0xaf8e30 2024-09-16T07:51:43.644 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.644+0000 7efe367fc640 1 -- 172.21.15.121:0/130096837 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7efe280057c0 con 0xaf8e30 2024-09-16T07:51:43.644 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.644+0000 7efe458edec0 1 -- 172.21.15.121:0/130096837 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x9f1380 con 0xaf8e30 2024-09-16T07:51:43.644 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.644+0000 7efe367fc640 1 -- 172.21.15.121:0/130096837 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7efe28037370 con 0xaf8e30 2024-09-16T07:51:43.644 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.644+0000 7efe458edec0 1 -- 172.21.15.121:0/130096837 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0xb7aa50 con 0xaf8e30 2024-09-16T07:51:43.644 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.645+0000 7efe367fc640 1 -- 172.21.15.121:0/130096837 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7efe28041040 con 0xaf8e30 2024-09-16T07:51:43.646 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.645+0000 7efe367fc640 1 --2- 172.21.15.121:0/130096837 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7efe2403d170 0x7efe2403f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:51:43.646 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.645+0000 7efe367fc640 1 -- 172.21.15.121:0/130096837 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(715..715 src has 620..715) ==== 4207+0+0 (crc 0 0 0) 0x7efe28032040 con 0xaf8e30 2024-09-16T07:51:43.646 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.646+0000 7efe458edec0 1 --2- 172.21.15.121:0/130096837 >> v2:172.21.15.172:6808/3418488586 conn(0xb91df0 0xc268a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:51:43.646 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.646+0000 7efe458edec0 1 -- 172.21.15.121:0/130096837 --> v2:172.21.15.172:6808/3418488586 -- osd_op(unknown.0.0:1 200.8 200:104778fc:::obj2:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e715) -- 0xb7a340 con 0xb91df0 2024-09-16T07:51:43.646 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.646+0000 7efe3d59a640 1 --2- 172.21.15.121:0/130096837 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7efe2403d170 0x7efe2403f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:51:43.646 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.646+0000 7efe3d59a640 1 --2- 172.21.15.121:0/130096837 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7efe2403d170 0x7efe2403f680 crc :-1 s=READY pgs=3830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:51:43.646 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.647+0000 7efe3e59c640 1 --2- 172.21.15.121:0/130096837 >> v2:172.21.15.172:6808/3418488586 conn(0xb91df0 0xc268a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T07:51:43.649 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.651+0000 7efe3e59c640 1 --2- 172.21.15.121:0/130096837 >> v2:172.21.15.172:6808/3418488586 conn(0xb91df0 0xc268a0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:51:43.676 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.677+0000 7efe3e59c640 1 -- 172.21.15.121:0/130096837 <== osd.3 v2:172.21.15.172:6808/3418488586 1 ==== osd_op_reply(1 obj2 [writefull 0~12875] v715'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7efe3000a430 con 0xb91df0 2024-09-16T07:51:43.676 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.677+0000 7efe458edec0 1 -- 172.21.15.121:0/130096837 >> v2:172.21.15.172:6808/3418488586 conn(0xb91df0 msgr2=0xc268a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:51:43.677 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.677+0000 7efe458edec0 1 --2- 172.21.15.121:0/130096837 >> v2:172.21.15.172:6808/3418488586 conn(0xb91df0 0xc268a0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:43.677 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.677+0000 7efe458edec0 1 -- 172.21.15.121:0/130096837 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7efe2403d170 msgr2=0x7efe2403f680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:51:43.677 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.677+0000 7efe458edec0 1 --2- 172.21.15.121:0/130096837 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7efe2403d170 0x7efe2403f680 crc :-1 s=READY pgs=3830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:43.677 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.677+0000 7efe458edec0 1 -- 172.21.15.121:0/130096837 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xaf8e30 msgr2=0xafaee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:51:43.677 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.677+0000 7efe458edec0 1 --2- 172.21.15.121:0/130096837 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xaf8e30 0xafaee0 crc :-1 s=READY pgs=12943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:43.677 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.677+0000 7efe458edec0 1 -- 172.21.15.121:0/130096837 shutdown_connections 2024-09-16T07:51:43.677 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.677+0000 7efe458edec0 1 --2- 172.21.15.121:0/130096837 >> v2:172.21.15.172:6808/3418488586 conn(0xb91df0 0xc268a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:43.677 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.677+0000 7efe458edec0 1 --2- 172.21.15.121:0/130096837 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7efe2403d170 0x7efe2403f680 unknown :-1 s=CLOSED pgs=3830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:43.677 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.677+0000 7efe458edec0 1 --2- 172.21.15.121:0/130096837 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xaf8e30 0xafaee0 unknown :-1 s=CLOSED pgs=12943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:43.677 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.677+0000 7efe458edec0 1 -- 172.21.15.121:0/130096837 >> 172.21.15.121:0/130096837 conn(0xa23770 msgr2=0xc176c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:51:43.677 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.677+0000 7efe458edec0 1 -- 172.21.15.121:0/130096837 shutdown_connections 2024-09-16T07:51:43.677 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.677+0000 7efe458edec0 1 -- 172.21.15.121:0/130096837 wait complete. 2024-09-16T07:51:43.678 INFO:tasks.workunit.client.0.smithi121.stderr:+ for f in `seq 1 10` 2024-09-16T07:51:43.678 INFO:tasks.workunit.client.0.smithi121.stderr:+ rados -p d3276ed3-e996-4bbc-b28e-567739f7faa8 put obj3 /etc/passwd 2024-09-16T07:51:43.715 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.716+0000 7f2eba02eec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:43.720 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.721+0000 7f2eba02eec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:43.720 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.721+0000 7f2eba02eec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:43.720 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.722+0000 7f2eba02eec0 1 Processor -- start 2024-09-16T07:51:43.720 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.722+0000 7f2eba02eec0 1 -- start start 2024-09-16T07:51:43.722 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.723+0000 7f2eba02eec0 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x140a9b0 0x137b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:51:43.722 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.723+0000 7f2eba02eec0 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x12dc520 con 0x140a9b0 2024-09-16T07:51:43.722 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.723+0000 7f2eb219b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x140a9b0 0x137b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:51:43.722 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.723+0000 7f2eb219b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x140a9b0 0x137b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:51934/0 (socket says 172.21.15.121:51934) 2024-09-16T07:51:43.722 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.723+0000 7f2eb219b640 1 -- 172.21.15.121:0/688720233 learned_addr learned my addr 172.21.15.121:0/688720233 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:51:43.722 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.723+0000 7f2eb219b640 1 -- 172.21.15.121:0/688720233 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1278e10 con 0x140a9b0 2024-09-16T07:51:43.723 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.723+0000 7f2eb219b640 1 --2- 172.21.15.121:0/688720233 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x140a9b0 0x137b9b0 crc :-1 s=READY pgs=12946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dd6639134ed515a server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:51:43.723 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.723+0000 7f2eb0998640 1 -- 172.21.15.121:0/688720233 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2e9c00b580 con 0x140a9b0 2024-09-16T07:51:43.723 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.723+0000 7f2eb0998640 1 -- 172.21.15.121:0/688720233 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f2e9c00b6e0 con 0x140a9b0 2024-09-16T07:51:43.723 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.723+0000 7f2eb0998640 1 -- 172.21.15.121:0/688720233 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2e9c00b980 con 0x140a9b0 2024-09-16T07:51:43.724 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.724+0000 7f2eba02eec0 1 -- 172.21.15.121:0/688720233 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x140a9b0 msgr2=0x137b9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:51:43.724 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.724+0000 7f2eba02eec0 1 --2- 172.21.15.121:0/688720233 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x140a9b0 0x137b9b0 crc :-1 s=READY pgs=12946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:43.724 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.724+0000 7f2eba02eec0 1 -- 172.21.15.121:0/688720233 shutdown_connections 2024-09-16T07:51:43.724 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.724+0000 7f2eba02eec0 1 --2- 172.21.15.121:0/688720233 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x140a9b0 0x137b9b0 unknown :-1 s=CLOSED pgs=12946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:43.724 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.724+0000 7f2eba02eec0 1 -- 172.21.15.121:0/688720233 >> 172.21.15.121:0/688720233 conn(0x129c770 msgr2=0x1373e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:51:43.724 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.724+0000 7f2eba02eec0 1 -- 172.21.15.121:0/688720233 shutdown_connections 2024-09-16T07:51:43.724 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.724+0000 7f2eba02eec0 1 -- 172.21.15.121:0/688720233 wait complete. 2024-09-16T07:51:43.724 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.725+0000 7f2eba02eec0 1 Processor -- start 2024-09-16T07:51:43.724 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.725+0000 7f2eba02eec0 1 -- start start 2024-09-16T07:51:43.726 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.726+0000 7f2eba02eec0 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x140a9b0 0x149f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:51:43.726 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.726+0000 7f2eba02eec0 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x12da280 con 0x140a9b0 2024-09-16T07:51:43.726 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.726+0000 7f2eb219b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x140a9b0 0x149f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:51:43.726 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.726+0000 7f2eb219b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x140a9b0 0x149f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:51936/0 (socket says 172.21.15.121:51936) 2024-09-16T07:51:43.726 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.726+0000 7f2eb219b640 1 -- 172.21.15.121:0/1675416811 learned_addr learned my addr 172.21.15.121:0/1675416811 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:51:43.726 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.726+0000 7f2eb219b640 1 -- 172.21.15.121:0/1675416811 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x126a920 con 0x140a9b0 2024-09-16T07:51:43.726 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.726+0000 7f2eb219b640 1 --2- 172.21.15.121:0/1675416811 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x140a9b0 0x149f500 crc :-1 s=READY pgs=12947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:51:43.726 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.726+0000 7f2eab7fe640 1 -- 172.21.15.121:0/1675416811 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2e9c0129e0 con 0x140a9b0 2024-09-16T07:51:43.726 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.726+0000 7f2eab7fe640 1 -- 172.21.15.121:0/1675416811 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f2e9c005040 con 0x140a9b0 2024-09-16T07:51:43.727 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.726+0000 7f2eba02eec0 1 -- 172.21.15.121:0/1675416811 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x126a380 con 0x140a9b0 2024-09-16T07:51:43.727 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.726+0000 7f2eab7fe640 1 -- 172.21.15.121:0/1675416811 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2e9c012c70 con 0x140a9b0 2024-09-16T07:51:43.727 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.726+0000 7f2eba02eec0 1 -- 172.21.15.121:0/1675416811 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x13f6640 con 0x140a9b0 2024-09-16T07:51:43.727 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.727+0000 7f2eab7fe640 1 -- 172.21.15.121:0/1675416811 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f2e9c00d040 con 0x140a9b0 2024-09-16T07:51:43.728 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.728+0000 7f2eab7fe640 1 --2- 172.21.15.121:0/1675416811 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f2e9803d170 0x7f2e9803f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:51:43.728 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.728+0000 7f2eab7fe640 1 -- 172.21.15.121:0/1675416811 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(715..715 src has 620..715) ==== 4207+0+0 (crc 0 0 0) 0x7f2e9c00a040 con 0x140a9b0 2024-09-16T07:51:43.728 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.728+0000 7f2eba02eec0 1 --2- 172.21.15.121:0/1675416811 >> v2:172.21.15.121:6801/4208564222 conn(0x140b4d0 0x1409600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:51:43.728 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.728+0000 7f2eba02eec0 1 -- 172.21.15.121:0/1675416811 --> v2:172.21.15.121:6801/4208564222 -- osd_op(unknown.0.0:1 200.1 200:8dd16f86:::obj3:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e715) -- 0x13f9ae0 con 0x140b4d0 2024-09-16T07:51:43.728 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.728+0000 7f2eb199a640 1 --2- 172.21.15.121:0/1675416811 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f2e9803d170 0x7f2e9803f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:51:43.728 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.729+0000 7f2eb199a640 1 --2- 172.21.15.121:0/1675416811 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f2e9803d170 0x7f2e9803f680 crc :-1 s=READY pgs=3831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:51:43.728 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.729+0000 7f2eb299c640 1 --2- 172.21.15.121:0/1675416811 >> v2:172.21.15.121:6801/4208564222 conn(0x140b4d0 0x1409600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T07:51:43.731 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.732+0000 7f2eb299c640 1 --2- 172.21.15.121:0/1675416811 >> v2:172.21.15.121:6801/4208564222 conn(0x140b4d0 0x1409600 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:51:43.745 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.745+0000 7f2eb299c640 1 -- 172.21.15.121:0/1675416811 <== osd.1 v2:172.21.15.121:6801/4208564222 1 ==== osd_op_reply(1 obj3 [writefull 0~12875] v715'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f2ea400a430 con 0x140b4d0 2024-09-16T07:51:43.745 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.746+0000 7f2eba02eec0 1 -- 172.21.15.121:0/1675416811 >> v2:172.21.15.121:6801/4208564222 conn(0x140b4d0 msgr2=0x1409600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:51:43.745 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.746+0000 7f2eba02eec0 1 --2- 172.21.15.121:0/1675416811 >> v2:172.21.15.121:6801/4208564222 conn(0x140b4d0 0x1409600 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:43.745 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.746+0000 7f2eba02eec0 1 -- 172.21.15.121:0/1675416811 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f2e9803d170 msgr2=0x7f2e9803f680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:51:43.745 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.746+0000 7f2eba02eec0 1 --2- 172.21.15.121:0/1675416811 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f2e9803d170 0x7f2e9803f680 crc :-1 s=READY pgs=3831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:43.745 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.746+0000 7f2eba02eec0 1 -- 172.21.15.121:0/1675416811 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x140a9b0 msgr2=0x149f500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:51:43.745 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.746+0000 7f2eba02eec0 1 --2- 172.21.15.121:0/1675416811 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x140a9b0 0x149f500 crc :-1 s=READY pgs=12947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:43.745 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.746+0000 7f2eba02eec0 1 -- 172.21.15.121:0/1675416811 shutdown_connections 2024-09-16T07:51:43.745 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.746+0000 7f2eba02eec0 1 --2- 172.21.15.121:0/1675416811 >> v2:172.21.15.121:6801/4208564222 conn(0x140b4d0 0x1409600 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:43.746 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.746+0000 7f2eba02eec0 1 --2- 172.21.15.121:0/1675416811 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f2e9803d170 0x7f2e9803f680 unknown :-1 s=CLOSED pgs=3831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:43.746 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.746+0000 7f2eba02eec0 1 --2- 172.21.15.121:0/1675416811 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x140a9b0 0x149f500 unknown :-1 s=CLOSED pgs=12947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:43.746 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.746+0000 7f2eba02eec0 1 -- 172.21.15.121:0/1675416811 >> 172.21.15.121:0/1675416811 conn(0x129c770 msgr2=0x1373930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:51:43.746 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.746+0000 7f2eba02eec0 1 -- 172.21.15.121:0/1675416811 shutdown_connections 2024-09-16T07:51:43.746 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.746+0000 7f2eba02eec0 1 -- 172.21.15.121:0/1675416811 wait complete. 2024-09-16T07:51:43.747 INFO:tasks.workunit.client.0.smithi121.stderr:+ for f in `seq 1 10` 2024-09-16T07:51:43.747 INFO:tasks.workunit.client.0.smithi121.stderr:+ rados -p d3276ed3-e996-4bbc-b28e-567739f7faa8 put obj4 /etc/passwd 2024-09-16T07:51:43.783 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.784+0000 7f8d7f2e7ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:43.788 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.789+0000 7f8d7f2e7ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:43.788 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.790+0000 7f8d7f2e7ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:43.789 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.790+0000 7f8d7f2e7ec0 1 Processor -- start 2024-09-16T07:51:43.789 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.790+0000 7f8d7f2e7ec0 1 -- start start 2024-09-16T07:51:43.791 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.791+0000 7f8d7f2e7ec0 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x1e4dc00 0x1ecb860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:51:43.791 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.791+0000 7f8d7f2e7ec0 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x1db1520 con 0x1e4dc00 2024-09-16T07:51:43.791 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.791+0000 7f8d7779b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x1e4dc00 0x1ecb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:51:43.791 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.791+0000 7f8d7779b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x1e4dc00 0x1ecb860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:51960/0 (socket says 172.21.15.121:51960) 2024-09-16T07:51:43.791 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.791+0000 7f8d7779b640 1 -- 172.21.15.121:0/3340660748 learned_addr learned my addr 172.21.15.121:0/3340660748 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:51:43.791 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.792+0000 7f8d7779b640 1 -- 172.21.15.121:0/3340660748 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1d4de10 con 0x1e4dc00 2024-09-16T07:51:43.791 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.792+0000 7f8d7779b640 1 --2- 172.21.15.121:0/3340660748 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x1e4dc00 0x1ecb860 crc :-1 s=READY pgs=12950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6268ba5809a292a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:51:43.791 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.792+0000 7f8d75f98640 1 -- 172.21.15.121:0/3340660748 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8d6002dc90 con 0x1e4dc00 2024-09-16T07:51:43.791 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.792+0000 7f8d75f98640 1 -- 172.21.15.121:0/3340660748 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f8d6002de90 con 0x1e4dc00 2024-09-16T07:51:43.791 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.792+0000 7f8d75f98640 1 -- 172.21.15.121:0/3340660748 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8d6000a170 con 0x1e4dc00 2024-09-16T07:51:43.792 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.793+0000 7f8d7f2e7ec0 1 -- 172.21.15.121:0/3340660748 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x1e4dc00 msgr2=0x1ecb860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:51:43.792 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.793+0000 7f8d7f2e7ec0 1 --2- 172.21.15.121:0/3340660748 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x1e4dc00 0x1ecb860 crc :-1 s=READY pgs=12950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:43.793 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.793+0000 7f8d7f2e7ec0 1 -- 172.21.15.121:0/3340660748 shutdown_connections 2024-09-16T07:51:43.793 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.793+0000 7f8d7f2e7ec0 1 --2- 172.21.15.121:0/3340660748 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x1e4dc00 0x1ecb860 unknown :-1 s=CLOSED pgs=12950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:43.793 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.793+0000 7f8d7f2e7ec0 1 -- 172.21.15.121:0/3340660748 >> 172.21.15.121:0/3340660748 conn(0x1d71770 msgr2=0x1e47840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:51:43.793 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.793+0000 7f8d7f2e7ec0 1 -- 172.21.15.121:0/3340660748 shutdown_connections 2024-09-16T07:51:43.793 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.793+0000 7f8d7f2e7ec0 1 -- 172.21.15.121:0/3340660748 wait complete. 2024-09-16T07:51:43.793 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.793+0000 7f8d7f2e7ec0 1 Processor -- start 2024-09-16T07:51:43.793 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.794+0000 7f8d7f2e7ec0 1 -- start start 2024-09-16T07:51:43.794 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.794+0000 7f8d7f2e7ec0 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x1e4dc00 0x1ecee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:51:43.794 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.795+0000 7f8d7f2e7ec0 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x1daf280 con 0x1e4dc00 2024-09-16T07:51:43.794 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.795+0000 7f8d7779b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x1e4dc00 0x1ecee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:51:43.795 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.795+0000 7f8d7779b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x1e4dc00 0x1ecee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:51970/0 (socket says 172.21.15.121:51970) 2024-09-16T07:51:43.795 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.795+0000 7f8d7779b640 1 -- 172.21.15.121:0/684950691 learned_addr learned my addr 172.21.15.121:0/684950691 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:51:43.795 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.795+0000 7f8d7779b640 1 -- 172.21.15.121:0/684950691 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1d3f920 con 0x1e4dc00 2024-09-16T07:51:43.795 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.795+0000 7f8d7779b640 1 --2- 172.21.15.121:0/684950691 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x1e4dc00 0x1ecee50 crc :-1 s=READY pgs=12951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:51:43.795 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.795+0000 7f8d74f96640 1 -- 172.21.15.121:0/684950691 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8d6003f040 con 0x1e4dc00 2024-09-16T07:51:43.795 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.795+0000 7f8d74f96640 1 -- 172.21.15.121:0/684950691 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f8d6002db60 con 0x1e4dc00 2024-09-16T07:51:43.795 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.795+0000 7f8d74f96640 1 -- 172.21.15.121:0/684950691 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8d6003ac10 con 0x1e4dc00 2024-09-16T07:51:43.795 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.795+0000 7f8d7f2e7ec0 1 -- 172.21.15.121:0/684950691 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1d3f380 con 0x1e4dc00 2024-09-16T07:51:43.795 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.795+0000 7f8d7f2e7ec0 1 -- 172.21.15.121:0/684950691 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1edf5e0 con 0x1e4dc00 2024-09-16T07:51:43.796 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.796+0000 7f8d74f96640 1 -- 172.21.15.121:0/684950691 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f8d600383e0 con 0x1e4dc00 2024-09-16T07:51:43.796 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.797+0000 7f8d74f96640 1 --2- 172.21.15.121:0/684950691 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f8d5c03d1c0 0x7f8d5c03f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:51:43.796 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.797+0000 7f8d74f96640 1 -- 172.21.15.121:0/684950691 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(715..715 src has 620..715) ==== 4207+0+0 (crc 0 0 0) 0x7f8d60032040 con 0x1e4dc00 2024-09-16T07:51:43.796 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.797+0000 7f8d7f2e7ec0 1 --2- 172.21.15.121:0/684950691 >> v2:172.21.15.172:6808/3418488586 conn(0x1e4e550 0x1ecf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:51:43.797 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.797+0000 7f8d7f2e7ec0 1 -- 172.21.15.121:0/684950691 --> v2:172.21.15.172:6808/3418488586 -- osd_op(unknown.0.0:1 200.0 200:0ee9ae15:::obj4:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e715) -- 0x2378a00 con 0x1e4e550 2024-09-16T07:51:43.797 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.797+0000 7f8d76f9a640 1 --2- 172.21.15.121:0/684950691 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f8d5c03d1c0 0x7f8d5c03f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:51:43.797 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.797+0000 7f8d76f9a640 1 --2- 172.21.15.121:0/684950691 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f8d5c03d1c0 0x7f8d5c03f6d0 crc :-1 s=READY pgs=3832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:51:43.797 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.797+0000 7f8d77f9c640 1 --2- 172.21.15.121:0/684950691 >> v2:172.21.15.172:6808/3418488586 conn(0x1e4e550 0x1ecf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T07:51:43.799 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.800+0000 7f8d77f9c640 1 --2- 172.21.15.121:0/684950691 >> v2:172.21.15.172:6808/3418488586 conn(0x1e4e550 0x1ecf8a0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:51:43.814 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.814+0000 7f8d77f9c640 1 -- 172.21.15.121:0/684950691 <== osd.3 v2:172.21.15.172:6808/3418488586 1 ==== osd_op_reply(1 obj4 [writefull 0~12875] v715'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f8d6800a430 con 0x1e4e550 2024-09-16T07:51:43.814 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.814+0000 7f8d7f2e7ec0 1 -- 172.21.15.121:0/684950691 >> v2:172.21.15.172:6808/3418488586 conn(0x1e4e550 msgr2=0x1ecf8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:51:43.814 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.814+0000 7f8d7f2e7ec0 1 --2- 172.21.15.121:0/684950691 >> v2:172.21.15.172:6808/3418488586 conn(0x1e4e550 0x1ecf8a0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:43.814 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.814+0000 7f8d7f2e7ec0 1 -- 172.21.15.121:0/684950691 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f8d5c03d1c0 msgr2=0x7f8d5c03f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:51:43.814 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.814+0000 7f8d7f2e7ec0 1 --2- 172.21.15.121:0/684950691 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f8d5c03d1c0 0x7f8d5c03f6d0 crc :-1 s=READY pgs=3832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:43.814 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.814+0000 7f8d7f2e7ec0 1 -- 172.21.15.121:0/684950691 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x1e4dc00 msgr2=0x1ecee50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:51:43.814 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.814+0000 7f8d7f2e7ec0 1 --2- 172.21.15.121:0/684950691 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x1e4dc00 0x1ecee50 crc :-1 s=READY pgs=12951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:43.814 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.814+0000 7f8d7f2e7ec0 1 -- 172.21.15.121:0/684950691 shutdown_connections 2024-09-16T07:51:43.814 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.814+0000 7f8d7f2e7ec0 1 --2- 172.21.15.121:0/684950691 >> v2:172.21.15.172:6808/3418488586 conn(0x1e4e550 0x1ecf8a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:43.815 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.814+0000 7f8d7f2e7ec0 1 --2- 172.21.15.121:0/684950691 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f8d5c03d1c0 0x7f8d5c03f6d0 unknown :-1 s=CLOSED pgs=3832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:43.815 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.814+0000 7f8d7f2e7ec0 1 --2- 172.21.15.121:0/684950691 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x1e4dc00 0x1ecee50 unknown :-1 s=CLOSED pgs=12951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:43.815 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.814+0000 7f8d7f2e7ec0 1 -- 172.21.15.121:0/684950691 >> 172.21.15.121:0/684950691 conn(0x1d71770 msgr2=0x1eca850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:51:43.815 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.814+0000 7f8d7f2e7ec0 1 -- 172.21.15.121:0/684950691 shutdown_connections 2024-09-16T07:51:43.815 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.814+0000 7f8d7f2e7ec0 1 -- 172.21.15.121:0/684950691 wait complete. 2024-09-16T07:51:43.815 INFO:tasks.workunit.client.0.smithi121.stderr:+ for f in `seq 1 10` 2024-09-16T07:51:43.815 INFO:tasks.workunit.client.0.smithi121.stderr:+ rados -p d3276ed3-e996-4bbc-b28e-567739f7faa8 put obj5 /etc/passwd 2024-09-16T07:51:43.852 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.853+0000 7feb90c43ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:43.857 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.858+0000 7feb90c43ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:43.857 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.858+0000 7feb90c43ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:43.857 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.859+0000 7feb90c43ec0 1 Processor -- start 2024-09-16T07:51:43.858 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.859+0000 7feb90c43ec0 1 -- start start 2024-09-16T07:51:43.859 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.860+0000 7feb90c43ec0 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x20da9b0 0x21628f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:51:43.859 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.860+0000 7feb90c43ec0 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x1fac520 con 0x20da9b0 2024-09-16T07:51:43.859 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.860+0000 7feb88d9b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x20da9b0 0x21628f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:51:43.859 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.860+0000 7feb88d9b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x20da9b0 0x21628f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:51994/0 (socket says 172.21.15.121:51994) 2024-09-16T07:51:43.860 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.860+0000 7feb88d9b640 1 -- 172.21.15.121:0/3200551627 learned_addr learned my addr 172.21.15.121:0/3200551627 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:51:43.860 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.860+0000 7feb88d9b640 1 -- 172.21.15.121:0/3200551627 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1f48e10 con 0x20da9b0 2024-09-16T07:51:43.860 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.860+0000 7feb88d9b640 1 --2- 172.21.15.121:0/3200551627 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x20da9b0 0x21628f0 crc :-1 s=READY pgs=12954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=477ea9f57b971166 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:51:43.860 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.860+0000 7feb82ffd640 1 -- 172.21.15.121:0/3200551627 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7feb7400c5e0 con 0x20da9b0 2024-09-16T07:51:43.860 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.860+0000 7feb82ffd640 1 -- 172.21.15.121:0/3200551627 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7feb7400c740 con 0x20da9b0 2024-09-16T07:51:43.860 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.860+0000 7feb82ffd640 1 -- 172.21.15.121:0/3200551627 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7feb7400c9e0 con 0x20da9b0 2024-09-16T07:51:43.862 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.861+0000 7feb90c43ec0 1 -- 172.21.15.121:0/3200551627 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x20da9b0 msgr2=0x21628f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:51:43.862 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.861+0000 7feb90c43ec0 1 --2- 172.21.15.121:0/3200551627 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x20da9b0 0x21628f0 crc :-1 s=READY pgs=12954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:43.863 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.861+0000 7feb90c43ec0 1 -- 172.21.15.121:0/3200551627 shutdown_connections 2024-09-16T07:51:43.863 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.861+0000 7feb90c43ec0 1 --2- 172.21.15.121:0/3200551627 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x20da9b0 0x21628f0 unknown :-1 s=CLOSED pgs=12954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:43.863 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.861+0000 7feb90c43ec0 1 -- 172.21.15.121:0/3200551627 >> 172.21.15.121:0/3200551627 conn(0x1f6c770 msgr2=0x20452b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:51:43.863 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.861+0000 7feb90c43ec0 1 -- 172.21.15.121:0/3200551627 shutdown_connections 2024-09-16T07:51:43.863 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.861+0000 7feb90c43ec0 1 -- 172.21.15.121:0/3200551627 wait complete. 2024-09-16T07:51:43.863 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.862+0000 7feb90c43ec0 1 Processor -- start 2024-09-16T07:51:43.863 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.862+0000 7feb90c43ec0 1 -- start start 2024-09-16T07:51:43.863 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.863+0000 7feb90c43ec0 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x20da9b0 0x216f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:51:43.863 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.863+0000 7feb90c43ec0 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x1faa280 con 0x20da9b0 2024-09-16T07:51:43.863 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.863+0000 7feb88d9b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x20da9b0 0x216f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:51:43.863 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.863+0000 7feb88d9b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x20da9b0 0x216f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:51998/0 (socket says 172.21.15.121:51998) 2024-09-16T07:51:43.863 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.863+0000 7feb88d9b640 1 -- 172.21.15.121:0/641564001 learned_addr learned my addr 172.21.15.121:0/641564001 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:51:43.864 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.863+0000 7feb88d9b640 1 -- 172.21.15.121:0/641564001 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1f3a920 con 0x20da9b0 2024-09-16T07:51:43.864 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.863+0000 7feb88d9b640 1 --2- 172.21.15.121:0/641564001 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x20da9b0 0x216f880 crc :-1 s=READY pgs=12955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:51:43.864 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.864+0000 7feb81ffb640 1 -- 172.21.15.121:0/641564001 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7feb740139c0 con 0x20da9b0 2024-09-16T07:51:43.864 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.864+0000 7feb81ffb640 1 -- 172.21.15.121:0/641564001 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7feb74013b20 con 0x20da9b0 2024-09-16T07:51:43.864 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.864+0000 7feb90c43ec0 1 -- 172.21.15.121:0/641564001 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1f3a380 con 0x20da9b0 2024-09-16T07:51:43.864 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.864+0000 7feb81ffb640 1 -- 172.21.15.121:0/641564001 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7feb74013dc0 con 0x20da9b0 2024-09-16T07:51:43.864 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.864+0000 7feb90c43ec0 1 -- 172.21.15.121:0/641564001 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x20da520 con 0x20da9b0 2024-09-16T07:51:43.865 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.865+0000 7feb81ffb640 1 -- 172.21.15.121:0/641564001 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7feb74010400 con 0x20da9b0 2024-09-16T07:51:43.865 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.865+0000 7feb81ffb640 1 --2- 172.21.15.121:0/641564001 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7feb7003d1c0 0x7feb7003f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:51:43.865 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.865+0000 7feb81ffb640 1 -- 172.21.15.121:0/641564001 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(715..715 src has 620..715) ==== 4207+0+0 (crc 0 0 0) 0x7feb74008040 con 0x20da9b0 2024-09-16T07:51:43.865 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.865+0000 7feb90c43ec0 1 --2- 172.21.15.121:0/641564001 >> v2:172.21.15.172:6808/3418488586 conn(0x20db4d0 0x20d9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:51:43.865 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.865+0000 7feb90c43ec0 1 -- 172.21.15.121:0/641564001 --> v2:172.21.15.172:6808/3418488586 -- osd_op(unknown.0.0:1 200.3 200:c52c9666:::obj5:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e715) -- 0x20c9af0 con 0x20db4d0 2024-09-16T07:51:43.865 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.865+0000 7feb83fff640 1 --2- 172.21.15.121:0/641564001 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7feb7003d1c0 0x7feb7003f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:51:43.865 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.866+0000 7feb83fff640 1 --2- 172.21.15.121:0/641564001 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7feb7003d1c0 0x7feb7003f6d0 crc :-1 s=READY pgs=3833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:51:43.866 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.866+0000 7feb8959c640 1 --2- 172.21.15.121:0/641564001 >> v2:172.21.15.172:6808/3418488586 conn(0x20db4d0 0x20d9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T07:51:43.869 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.870+0000 7feb8959c640 1 --2- 172.21.15.121:0/641564001 >> v2:172.21.15.172:6808/3418488586 conn(0x20db4d0 0x20d9460 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:51:43.883 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.884+0000 7feb8959c640 1 -- 172.21.15.121:0/641564001 <== osd.3 v2:172.21.15.172:6808/3418488586 1 ==== osd_op_reply(1 obj5 [writefull 0~12875] v715'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7feb7c00a430 con 0x20db4d0 2024-09-16T07:51:43.884 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.884+0000 7feb90c43ec0 1 -- 172.21.15.121:0/641564001 >> v2:172.21.15.172:6808/3418488586 conn(0x20db4d0 msgr2=0x20d9460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:51:43.884 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.884+0000 7feb90c43ec0 1 --2- 172.21.15.121:0/641564001 >> v2:172.21.15.172:6808/3418488586 conn(0x20db4d0 0x20d9460 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:43.884 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.884+0000 7feb90c43ec0 1 -- 172.21.15.121:0/641564001 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7feb7003d1c0 msgr2=0x7feb7003f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:51:43.884 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.884+0000 7feb90c43ec0 1 --2- 172.21.15.121:0/641564001 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7feb7003d1c0 0x7feb7003f6d0 crc :-1 s=READY pgs=3833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:43.884 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.884+0000 7feb90c43ec0 1 -- 172.21.15.121:0/641564001 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x20da9b0 msgr2=0x216f880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:51:43.884 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.884+0000 7feb90c43ec0 1 --2- 172.21.15.121:0/641564001 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x20da9b0 0x216f880 crc :-1 s=READY pgs=12955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:43.884 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.884+0000 7feb90c43ec0 1 -- 172.21.15.121:0/641564001 shutdown_connections 2024-09-16T07:51:43.884 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.884+0000 7feb90c43ec0 1 --2- 172.21.15.121:0/641564001 >> v2:172.21.15.172:6808/3418488586 conn(0x20db4d0 0x20d9460 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:43.884 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.884+0000 7feb90c43ec0 1 --2- 172.21.15.121:0/641564001 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7feb7003d1c0 0x7feb7003f6d0 unknown :-1 s=CLOSED pgs=3833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:43.884 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.884+0000 7feb90c43ec0 1 --2- 172.21.15.121:0/641564001 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x20da9b0 0x216f880 unknown :-1 s=CLOSED pgs=12955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:43.884 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.884+0000 7feb90c43ec0 1 -- 172.21.15.121:0/641564001 >> 172.21.15.121:0/641564001 conn(0x1f6c770 msgr2=0x20452b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:51:43.885 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.884+0000 7feb90c43ec0 1 -- 172.21.15.121:0/641564001 shutdown_connections 2024-09-16T07:51:43.885 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.884+0000 7feb90c43ec0 1 -- 172.21.15.121:0/641564001 wait complete. 2024-09-16T07:51:43.885 INFO:tasks.workunit.client.0.smithi121.stderr:+ for f in `seq 1 10` 2024-09-16T07:51:43.885 INFO:tasks.workunit.client.0.smithi121.stderr:+ rados -p d3276ed3-e996-4bbc-b28e-567739f7faa8 put obj6 /etc/passwd 2024-09-16T07:51:43.921 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.923+0000 7fedf963aec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:43.926 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.928+0000 7fedf963aec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:43.927 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.928+0000 7fedf963aec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:43.927 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.928+0000 7fedf963aec0 1 Processor -- start 2024-09-16T07:51:43.927 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.928+0000 7fedf963aec0 1 -- start start 2024-09-16T07:51:43.929 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.929+0000 7fedf963aec0 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x14defc0 0x1605200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:51:43.929 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.929+0000 7fedf963aec0 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x144b520 con 0x14defc0 2024-09-16T07:51:43.929 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.929+0000 7fedf179b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x14defc0 0x1605200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:51:43.929 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.930+0000 7fedf179b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x14defc0 0x1605200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:52008/0 (socket says 172.21.15.121:52008) 2024-09-16T07:51:43.929 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.930+0000 7fedf179b640 1 -- 172.21.15.121:0/3925207557 learned_addr learned my addr 172.21.15.121:0/3925207557 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:51:43.929 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.930+0000 7fedf179b640 1 -- 172.21.15.121:0/3925207557 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x13e7e10 con 0x14defc0 2024-09-16T07:51:43.929 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.930+0000 7fedf179b640 1 --2- 172.21.15.121:0/3925207557 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x14defc0 0x1605200 crc :-1 s=READY pgs=12958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ac7fb5bb36f2a21 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:51:43.929 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.930+0000 7fedeb7fe640 1 -- 172.21.15.121:0/3925207557 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7feddc0057c0 con 0x14defc0 2024-09-16T07:51:43.929 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.930+0000 7fedeb7fe640 1 -- 172.21.15.121:0/3925207557 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7feddc00a380 con 0x14defc0 2024-09-16T07:51:43.930 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.930+0000 7fedeb7fe640 1 -- 172.21.15.121:0/3925207557 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7feddc02fa60 con 0x14defc0 2024-09-16T07:51:43.931 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.931+0000 7fedf963aec0 1 -- 172.21.15.121:0/3925207557 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x14defc0 msgr2=0x1605200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:51:43.931 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.931+0000 7fedf963aec0 1 --2- 172.21.15.121:0/3925207557 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x14defc0 0x1605200 crc :-1 s=READY pgs=12958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:43.931 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.931+0000 7fedf963aec0 1 -- 172.21.15.121:0/3925207557 shutdown_connections 2024-09-16T07:51:43.931 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.931+0000 7fedf963aec0 1 --2- 172.21.15.121:0/3925207557 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x14defc0 0x1605200 unknown :-1 s=CLOSED pgs=12958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:43.931 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.931+0000 7fedf963aec0 1 -- 172.21.15.121:0/3925207557 >> 172.21.15.121:0/3925207557 conn(0x140b770 msgr2=0x14ea9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:51:43.931 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.931+0000 7fedf963aec0 1 -- 172.21.15.121:0/3925207557 shutdown_connections 2024-09-16T07:51:43.931 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.931+0000 7fedf963aec0 1 -- 172.21.15.121:0/3925207557 wait complete. 2024-09-16T07:51:43.931 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.931+0000 7fedf963aec0 1 Processor -- start 2024-09-16T07:51:43.931 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.932+0000 7fedf963aec0 1 -- start start 2024-09-16T07:51:43.933 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.932+0000 7fedf963aec0 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x14defc0 0x15ec9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:51:43.933 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.932+0000 7fedf963aec0 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x1449280 con 0x14defc0 2024-09-16T07:51:43.933 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.933+0000 7fedf179b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x14defc0 0x15ec9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:51:43.934 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.933+0000 7fedf179b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x14defc0 0x15ec9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:52010/0 (socket says 172.21.15.121:52010) 2024-09-16T07:51:43.934 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.933+0000 7fedf179b640 1 -- 172.21.15.121:0/1550698771 learned_addr learned my addr 172.21.15.121:0/1550698771 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:51:43.934 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.933+0000 7fedf179b640 1 -- 172.21.15.121:0/1550698771 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x13d9920 con 0x14defc0 2024-09-16T07:51:43.934 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.933+0000 7fedf179b640 1 --2- 172.21.15.121:0/1550698771 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x14defc0 0x15ec9d0 crc :-1 s=READY pgs=12959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:51:43.934 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.933+0000 7fedea7fc640 1 -- 172.21.15.121:0/1550698771 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7feddc02fa90 con 0x14defc0 2024-09-16T07:51:43.934 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.933+0000 7fedea7fc640 1 -- 172.21.15.121:0/1550698771 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7feddc008590 con 0x14defc0 2024-09-16T07:51:43.934 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.933+0000 7fedf963aec0 1 -- 172.21.15.121:0/1550698771 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x13d9380 con 0x14defc0 2024-09-16T07:51:43.934 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.933+0000 7fedea7fc640 1 -- 172.21.15.121:0/1550698771 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7feddc008830 con 0x14defc0 2024-09-16T07:51:43.934 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.933+0000 7fedf963aec0 1 -- 172.21.15.121:0/1550698771 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x15eaed0 con 0x14defc0 2024-09-16T07:51:43.934 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.934+0000 7fedea7fc640 1 -- 172.21.15.121:0/1550698771 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7feddc037040 con 0x14defc0 2024-09-16T07:51:43.934 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.934+0000 7fedea7fc640 1 --2- 172.21.15.121:0/1550698771 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fedd803d1c0 0x7fedd803f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:51:43.934 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.934+0000 7fedea7fc640 1 -- 172.21.15.121:0/1550698771 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(715..715 src has 620..715) ==== 4207+0+0 (crc 0 0 0) 0x7feddc034040 con 0x14defc0 2024-09-16T07:51:43.934 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.935+0000 7fedf963aec0 1 --2- 172.21.15.121:0/1550698771 >> v2:172.21.15.121:6801/4208564222 conn(0x14e7130 0x160c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:51:43.935 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.935+0000 7fedf963aec0 1 -- 172.21.15.121:0/1550698771 --> v2:172.21.15.121:6801/4208564222 -- osd_op(unknown.0.0:1 200.4 200:233a42c1:::obj6:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e715) -- 0x160c9e0 con 0x14e7130 2024-09-16T07:51:43.935 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.935+0000 7fedf0f9a640 1 --2- 172.21.15.121:0/1550698771 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fedd803d1c0 0x7fedd803f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:51:43.935 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.935+0000 7fedf1f9c640 1 --2- 172.21.15.121:0/1550698771 >> v2:172.21.15.121:6801/4208564222 conn(0x14e7130 0x160c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T07:51:43.935 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.936+0000 7fedf0f9a640 1 --2- 172.21.15.121:0/1550698771 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fedd803d1c0 0x7fedd803f6d0 crc :-1 s=READY pgs=3834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:51:43.936 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.937+0000 7fedf1f9c640 1 --2- 172.21.15.121:0/1550698771 >> v2:172.21.15.121:6801/4208564222 conn(0x14e7130 0x160c4a0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:51:43.949 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.949+0000 7fedf1f9c640 1 -- 172.21.15.121:0/1550698771 <== osd.1 v2:172.21.15.121:6801/4208564222 1 ==== osd_op_reply(1 obj6 [writefull 0~12875] v715'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fede400a430 con 0x14e7130 2024-09-16T07:51:43.949 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.949+0000 7fedf963aec0 1 -- 172.21.15.121:0/1550698771 >> v2:172.21.15.121:6801/4208564222 conn(0x14e7130 msgr2=0x160c4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:51:43.949 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.949+0000 7fedf963aec0 1 --2- 172.21.15.121:0/1550698771 >> v2:172.21.15.121:6801/4208564222 conn(0x14e7130 0x160c4a0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:43.949 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.949+0000 7fedf963aec0 1 -- 172.21.15.121:0/1550698771 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fedd803d1c0 msgr2=0x7fedd803f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:51:43.949 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.949+0000 7fedf963aec0 1 --2- 172.21.15.121:0/1550698771 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fedd803d1c0 0x7fedd803f6d0 crc :-1 s=READY pgs=3834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:43.949 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.949+0000 7fedf963aec0 1 -- 172.21.15.121:0/1550698771 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x14defc0 msgr2=0x15ec9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:51:43.950 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.949+0000 7fedf963aec0 1 --2- 172.21.15.121:0/1550698771 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x14defc0 0x15ec9d0 crc :-1 s=READY pgs=12959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:43.950 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.950+0000 7fedf963aec0 1 -- 172.21.15.121:0/1550698771 shutdown_connections 2024-09-16T07:51:43.950 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.950+0000 7fedf963aec0 1 --2- 172.21.15.121:0/1550698771 >> v2:172.21.15.121:6801/4208564222 conn(0x14e7130 0x160c4a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:43.950 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.950+0000 7fedf963aec0 1 --2- 172.21.15.121:0/1550698771 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fedd803d1c0 0x7fedd803f6d0 unknown :-1 s=CLOSED pgs=3834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:43.950 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.950+0000 7fedf963aec0 1 --2- 172.21.15.121:0/1550698771 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x14defc0 0x15ec9d0 unknown :-1 s=CLOSED pgs=12959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:43.950 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.950+0000 7fedf963aec0 1 -- 172.21.15.121:0/1550698771 >> 172.21.15.121:0/1550698771 conn(0x140b770 msgr2=0x14eb2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:51:43.950 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.950+0000 7fedf963aec0 1 -- 172.21.15.121:0/1550698771 shutdown_connections 2024-09-16T07:51:43.950 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.950+0000 7fedf963aec0 1 -- 172.21.15.121:0/1550698771 wait complete. 2024-09-16T07:51:43.951 INFO:tasks.workunit.client.0.smithi121.stderr:+ for f in `seq 1 10` 2024-09-16T07:51:43.951 INFO:tasks.workunit.client.0.smithi121.stderr:+ rados -p d3276ed3-e996-4bbc-b28e-567739f7faa8 put obj7 /etc/passwd 2024-09-16T07:51:43.987 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.988+0000 7fbedb6fdec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:43.992 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.993+0000 7fbedb6fdec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:43.992 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.994+0000 7fbedb6fdec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:43.993 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.994+0000 7fbedb6fdec0 1 Processor -- start 2024-09-16T07:51:43.993 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.994+0000 7fbedb6fdec0 1 -- start start 2024-09-16T07:51:43.994 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.995+0000 7fbedb6fdec0 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x16179b0 0x16a0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:51:43.995 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.995+0000 7fbedb6fdec0 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x14e9520 con 0x16179b0 2024-09-16T07:51:43.995 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.995+0000 7fbeceffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x16179b0 0x16a0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:51:43.995 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.995+0000 7fbeceffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x16179b0 0x16a0730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:52028/0 (socket says 172.21.15.121:52028) 2024-09-16T07:51:43.995 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.995+0000 7fbeceffd640 1 -- 172.21.15.121:0/1963963781 learned_addr learned my addr 172.21.15.121:0/1963963781 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:51:43.995 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.996+0000 7fbeceffd640 1 -- 172.21.15.121:0/1963963781 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1485e10 con 0x16179b0 2024-09-16T07:51:43.995 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.996+0000 7fbeceffd640 1 --2- 172.21.15.121:0/1963963781 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x16179b0 0x16a0730 crc :-1 s=READY pgs=12962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28349d430baf6ae8 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:51:43.995 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.996+0000 7fbecdffb640 1 -- 172.21.15.121:0/1963963781 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbec000b580 con 0x16179b0 2024-09-16T07:51:43.995 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.996+0000 7fbecdffb640 1 -- 172.21.15.121:0/1963963781 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fbec000b6e0 con 0x16179b0 2024-09-16T07:51:43.995 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.996+0000 7fbecdffb640 1 -- 172.21.15.121:0/1963963781 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbec000b980 con 0x16179b0 2024-09-16T07:51:43.996 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.997+0000 7fbedb6fdec0 1 -- 172.21.15.121:0/1963963781 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x16179b0 msgr2=0x16a0730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:51:43.996 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.997+0000 7fbedb6fdec0 1 --2- 172.21.15.121:0/1963963781 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x16179b0 0x16a0730 crc :-1 s=READY pgs=12962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:43.996 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.997+0000 7fbedb6fdec0 1 -- 172.21.15.121:0/1963963781 shutdown_connections 2024-09-16T07:51:43.997 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.997+0000 7fbedb6fdec0 1 --2- 172.21.15.121:0/1963963781 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x16179b0 0x16a0730 unknown :-1 s=CLOSED pgs=12962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:43.997 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.997+0000 7fbedb6fdec0 1 -- 172.21.15.121:0/1963963781 >> 172.21.15.121:0/1963963781 conn(0x14a9770 msgr2=0x1580e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:51:43.997 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.997+0000 7fbedb6fdec0 1 -- 172.21.15.121:0/1963963781 shutdown_connections 2024-09-16T07:51:43.997 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.997+0000 7fbedb6fdec0 1 -- 172.21.15.121:0/1963963781 wait complete. 2024-09-16T07:51:43.997 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.997+0000 7fbedb6fdec0 1 Processor -- start 2024-09-16T07:51:43.997 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.997+0000 7fbedb6fdec0 1 -- start start 2024-09-16T07:51:43.999 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.999+0000 7fbedb6fdec0 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x16179b0 0x1604c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:51:43.999 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.999+0000 7fbedb6fdec0 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x14e7280 con 0x16179b0 2024-09-16T07:51:44.000 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.999+0000 7fbeceffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x16179b0 0x1604c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:51:44.000 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.999+0000 7fbeceffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x16179b0 0x1604c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:52032/0 (socket says 172.21.15.121:52032) 2024-09-16T07:51:44.000 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.999+0000 7fbeceffd640 1 -- 172.21.15.121:0/2550782893 learned_addr learned my addr 172.21.15.121:0/2550782893 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:51:44.000 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.999+0000 7fbeceffd640 1 -- 172.21.15.121:0/2550782893 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1477920 con 0x16179b0 2024-09-16T07:51:44.000 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.999+0000 7fbeceffd640 1 --2- 172.21.15.121:0/2550782893 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x16179b0 0x1604c50 crc :-1 s=READY pgs=12963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:51:44.000 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.999+0000 7fbeccff9640 1 -- 172.21.15.121:0/2550782893 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbec0012b10 con 0x16179b0 2024-09-16T07:51:44.000 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.999+0000 7fbeccff9640 1 -- 172.21.15.121:0/2550782893 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fbec0005040 con 0x16179b0 2024-09-16T07:51:44.000 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.999+0000 7fbeccff9640 1 -- 172.21.15.121:0/2550782893 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbec0012da0 con 0x16179b0 2024-09-16T07:51:44.000 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.999+0000 7fbedb6fdec0 1 -- 172.21.15.121:0/2550782893 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1477380 con 0x16179b0 2024-09-16T07:51:44.000 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:43.999+0000 7fbedb6fdec0 1 -- 172.21.15.121:0/2550782893 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x16073a0 con 0x16179b0 2024-09-16T07:51:44.000 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.000+0000 7fbeccff9640 1 -- 172.21.15.121:0/2550782893 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fbec000d040 con 0x16179b0 2024-09-16T07:51:44.000 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.000+0000 7fbeccff9640 1 --2- 172.21.15.121:0/2550782893 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fbeb003d1c0 0x7fbeb003f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:51:44.001 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.000+0000 7fbeccff9640 1 -- 172.21.15.121:0/2550782893 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(715..715 src has 620..715) ==== 4207+0+0 (crc 0 0 0) 0x7fbec000a040 con 0x16179b0 2024-09-16T07:51:44.001 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.001+0000 7fbec67fc640 1 --2- 172.21.15.121:0/2550782893 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fbeb003d1c0 0x7fbeb003f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:51:44.001 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.001+0000 7fbedb6fdec0 1 --2- 172.21.15.121:0/2550782893 >> v2:172.21.15.121:6808/3193900849 conn(0x16184d0 0x1615610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:51:44.001 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.001+0000 7fbedb6fdec0 1 -- 172.21.15.121:0/2550782893 --> v2:172.21.15.121:6808/3193900849 -- osd_op(unknown.0.0:1 200.9 200:9a09113a:::obj7:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e715) -- 0x1607b80 con 0x16184d0 2024-09-16T07:51:44.001 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.001+0000 7fbec67fc640 1 --2- 172.21.15.121:0/2550782893 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fbeb003d1c0 0x7fbeb003f6d0 crc :-1 s=READY pgs=3835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:51:44.001 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.002+0000 7fbecf7fe640 1 --2- 172.21.15.121:0/2550782893 >> v2:172.21.15.121:6808/3193900849 conn(0x16184d0 0x1615610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T07:51:44.006 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.007+0000 7fbecf7fe640 1 --2- 172.21.15.121:0/2550782893 >> v2:172.21.15.121:6808/3193900849 conn(0x16184d0 0x1615610 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:51:44.020 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.020+0000 7fbecf7fe640 1 -- 172.21.15.121:0/2550782893 <== osd.0 v2:172.21.15.121:6808/3193900849 1 ==== osd_op_reply(1 obj7 [writefull 0~12875] v715'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fbec800a430 con 0x16184d0 2024-09-16T07:51:44.020 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.020+0000 7fbedb6fdec0 1 -- 172.21.15.121:0/2550782893 >> v2:172.21.15.121:6808/3193900849 conn(0x16184d0 msgr2=0x1615610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:51:44.020 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.020+0000 7fbedb6fdec0 1 --2- 172.21.15.121:0/2550782893 >> v2:172.21.15.121:6808/3193900849 conn(0x16184d0 0x1615610 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:44.020 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.020+0000 7fbedb6fdec0 1 -- 172.21.15.121:0/2550782893 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fbeb003d1c0 msgr2=0x7fbeb003f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:51:44.020 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.020+0000 7fbedb6fdec0 1 --2- 172.21.15.121:0/2550782893 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fbeb003d1c0 0x7fbeb003f6d0 crc :-1 s=READY pgs=3835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:44.020 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.020+0000 7fbedb6fdec0 1 -- 172.21.15.121:0/2550782893 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x16179b0 msgr2=0x1604c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:51:44.020 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.020+0000 7fbedb6fdec0 1 --2- 172.21.15.121:0/2550782893 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x16179b0 0x1604c50 crc :-1 s=READY pgs=12963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:44.020 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.020+0000 7fbedb6fdec0 1 -- 172.21.15.121:0/2550782893 shutdown_connections 2024-09-16T07:51:44.020 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.020+0000 7fbedb6fdec0 1 --2- 172.21.15.121:0/2550782893 >> v2:172.21.15.121:6808/3193900849 conn(0x16184d0 0x1615610 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:44.020 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.020+0000 7fbedb6fdec0 1 --2- 172.21.15.121:0/2550782893 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fbeb003d1c0 0x7fbeb003f6d0 unknown :-1 s=CLOSED pgs=3835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:44.020 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.020+0000 7fbedb6fdec0 1 --2- 172.21.15.121:0/2550782893 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x16179b0 0x1604c50 unknown :-1 s=CLOSED pgs=12963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:44.021 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.020+0000 7fbedb6fdec0 1 -- 172.21.15.121:0/2550782893 >> 172.21.15.121:0/2550782893 conn(0x14a9770 msgr2=0x1582ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:51:44.021 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.021+0000 7fbedb6fdec0 1 -- 172.21.15.121:0/2550782893 shutdown_connections 2024-09-16T07:51:44.021 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.021+0000 7fbedb6fdec0 1 -- 172.21.15.121:0/2550782893 wait complete. 2024-09-16T07:51:44.022 INFO:tasks.workunit.client.0.smithi121.stderr:+ for f in `seq 1 10` 2024-09-16T07:51:44.022 INFO:tasks.workunit.client.0.smithi121.stderr:+ rados -p d3276ed3-e996-4bbc-b28e-567739f7faa8 put obj8 /etc/passwd 2024-09-16T07:51:44.058 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.059+0000 7ff2dc4feec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:44.063 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.064+0000 7ff2dc4feec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:44.063 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.064+0000 7ff2dc4feec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:44.063 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.065+0000 7ff2dc4feec0 1 Processor -- start 2024-09-16T07:51:44.063 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.065+0000 7ff2dc4feec0 1 -- start start 2024-09-16T07:51:44.065 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.066+0000 7ff2dc4feec0 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x712300 0x82c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:51:44.065 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.066+0000 7ff2dc4feec0 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x676520 con 0x712300 2024-09-16T07:51:44.065 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.066+0000 7ff2d499b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x712300 0x82c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:51:44.065 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.066+0000 7ff2d499b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x712300 0x82c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:52056/0 (socket says 172.21.15.121:52056) 2024-09-16T07:51:44.065 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.066+0000 7ff2d499b640 1 -- 172.21.15.121:0/3212099502 learned_addr learned my addr 172.21.15.121:0/3212099502 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:51:44.065 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.066+0000 7ff2d499b640 1 -- 172.21.15.121:0/3212099502 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x612e10 con 0x712300 2024-09-16T07:51:44.065 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.066+0000 7ff2d499b640 1 --2- 172.21.15.121:0/3212099502 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x712300 0x82c740 crc :-1 s=READY pgs=12966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27b5564e45958893 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:51:44.066 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.066+0000 7ff2ce7fc640 1 -- 172.21.15.121:0/3212099502 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff2c00061e0 con 0x712300 2024-09-16T07:51:44.066 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.066+0000 7ff2ce7fc640 1 -- 172.21.15.121:0/3212099502 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff2c0006340 con 0x712300 2024-09-16T07:51:44.066 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.066+0000 7ff2ce7fc640 1 -- 172.21.15.121:0/3212099502 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff2c0001b00 con 0x712300 2024-09-16T07:51:44.067 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.067+0000 7ff2dc4feec0 1 -- 172.21.15.121:0/3212099502 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x712300 msgr2=0x82c740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:51:44.067 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.067+0000 7ff2dc4feec0 1 --2- 172.21.15.121:0/3212099502 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x712300 0x82c740 crc :-1 s=READY pgs=12966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:44.067 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.067+0000 7ff2dc4feec0 1 -- 172.21.15.121:0/3212099502 shutdown_connections 2024-09-16T07:51:44.067 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.067+0000 7ff2dc4feec0 1 --2- 172.21.15.121:0/3212099502 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x712300 0x82c740 unknown :-1 s=CLOSED pgs=12966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:44.067 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.067+0000 7ff2dc4feec0 1 -- 172.21.15.121:0/3212099502 >> 172.21.15.121:0/3212099502 conn(0x636770 msgr2=0x7146f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:51:44.067 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.067+0000 7ff2dc4feec0 1 -- 172.21.15.121:0/3212099502 shutdown_connections 2024-09-16T07:51:44.067 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.067+0000 7ff2dc4feec0 1 -- 172.21.15.121:0/3212099502 wait complete. 2024-09-16T07:51:44.067 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.068+0000 7ff2dc4feec0 1 Processor -- start 2024-09-16T07:51:44.067 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.068+0000 7ff2dc4feec0 1 -- start start 2024-09-16T07:51:44.069 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.069+0000 7ff2dc4feec0 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x712300 0x791700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:51:44.069 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.069+0000 7ff2dc4feec0 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x674280 con 0x712300 2024-09-16T07:51:44.069 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.069+0000 7ff2d499b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x712300 0x791700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:51:44.069 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.069+0000 7ff2d499b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x712300 0x791700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:52070/0 (socket says 172.21.15.121:52070) 2024-09-16T07:51:44.069 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.069+0000 7ff2d499b640 1 -- 172.21.15.121:0/1331450891 learned_addr learned my addr 172.21.15.121:0/1331450891 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:51:44.069 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.069+0000 7ff2d499b640 1 -- 172.21.15.121:0/1331450891 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x604920 con 0x712300 2024-09-16T07:51:44.069 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.069+0000 7ff2d499b640 1 --2- 172.21.15.121:0/1331450891 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x712300 0x791700 crc :-1 s=READY pgs=12967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:51:44.069 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.069+0000 7ff2cd7fa640 1 -- 172.21.15.121:0/1331450891 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff2c00049e0 con 0x712300 2024-09-16T07:51:44.069 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.069+0000 7ff2cd7fa640 1 -- 172.21.15.121:0/1331450891 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff2c0004b40 con 0x712300 2024-09-16T07:51:44.069 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.069+0000 7ff2cd7fa640 1 -- 172.21.15.121:0/1331450891 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff2c0004de0 con 0x712300 2024-09-16T07:51:44.069 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.069+0000 7ff2dc4feec0 1 -- 172.21.15.121:0/1331450891 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x604380 con 0x712300 2024-09-16T07:51:44.069 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.069+0000 7ff2dc4feec0 1 -- 172.21.15.121:0/1331450891 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x793030 con 0x712300 2024-09-16T07:51:44.071 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.070+0000 7ff2cd7fa640 1 -- 172.21.15.121:0/1331450891 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7ff2c00133a0 con 0x712300 2024-09-16T07:51:44.071 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.071+0000 7ff2cd7fa640 1 --2- 172.21.15.121:0/1331450891 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7ff2bc03d170 0x7ff2bc03f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:51:44.071 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.071+0000 7ff2cd7fa640 1 -- 172.21.15.121:0/1331450891 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(715..715 src has 620..715) ==== 4207+0+0 (crc 0 0 0) 0x7ff2c004feb0 con 0x712300 2024-09-16T07:51:44.071 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.071+0000 7ff2dc4feec0 1 --2- 172.21.15.121:0/1331450891 >> v2:172.21.15.121:6808/3193900849 conn(0x712e20 0x839820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:51:44.071 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.071+0000 7ff2dc4feec0 1 -- 172.21.15.121:0/1331450891 --> v2:172.21.15.121:6808/3193900849 -- osd_op(unknown.0.0:1 200.5 200:a557efb1:::obj8:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e715) -- 0x795090 con 0x712e20 2024-09-16T07:51:44.071 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.071+0000 7ff2cf7fe640 1 --2- 172.21.15.121:0/1331450891 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7ff2bc03d170 0x7ff2bc03f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:51:44.071 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.071+0000 7ff2cf7fe640 1 --2- 172.21.15.121:0/1331450891 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7ff2bc03d170 0x7ff2bc03f680 crc :-1 s=READY pgs=3836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:51:44.071 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.072+0000 7ff2d519c640 1 --2- 172.21.15.121:0/1331450891 >> v2:172.21.15.121:6808/3193900849 conn(0x712e20 0x839820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T07:51:44.073 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.074+0000 7ff2d519c640 1 --2- 172.21.15.121:0/1331450891 >> v2:172.21.15.121:6808/3193900849 conn(0x712e20 0x839820 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:51:44.088 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.088+0000 7ff2d519c640 1 -- 172.21.15.121:0/1331450891 <== osd.0 v2:172.21.15.121:6808/3193900849 1 ==== osd_op_reply(1 obj8 [writefull 0~12875] v715'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7ff2c800c430 con 0x712e20 2024-09-16T07:51:44.088 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.088+0000 7ff2dc4feec0 1 -- 172.21.15.121:0/1331450891 >> v2:172.21.15.121:6808/3193900849 conn(0x712e20 msgr2=0x839820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:51:44.088 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.088+0000 7ff2dc4feec0 1 --2- 172.21.15.121:0/1331450891 >> v2:172.21.15.121:6808/3193900849 conn(0x712e20 0x839820 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:44.088 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.088+0000 7ff2dc4feec0 1 -- 172.21.15.121:0/1331450891 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7ff2bc03d170 msgr2=0x7ff2bc03f680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:51:44.088 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.088+0000 7ff2dc4feec0 1 --2- 172.21.15.121:0/1331450891 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7ff2bc03d170 0x7ff2bc03f680 crc :-1 s=READY pgs=3836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:44.089 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.088+0000 7ff2dc4feec0 1 -- 172.21.15.121:0/1331450891 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x712300 msgr2=0x791700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:51:44.089 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.088+0000 7ff2dc4feec0 1 --2- 172.21.15.121:0/1331450891 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x712300 0x791700 crc :-1 s=READY pgs=12967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:44.089 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.088+0000 7ff2dc4feec0 1 -- 172.21.15.121:0/1331450891 shutdown_connections 2024-09-16T07:51:44.089 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.088+0000 7ff2dc4feec0 1 --2- 172.21.15.121:0/1331450891 >> v2:172.21.15.121:6808/3193900849 conn(0x712e20 0x839820 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:44.089 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.088+0000 7ff2dc4feec0 1 --2- 172.21.15.121:0/1331450891 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7ff2bc03d170 0x7ff2bc03f680 unknown :-1 s=CLOSED pgs=3836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:44.089 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.088+0000 7ff2dc4feec0 1 --2- 172.21.15.121:0/1331450891 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x712300 0x791700 unknown :-1 s=CLOSED pgs=12967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:44.089 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.088+0000 7ff2dc4feec0 1 -- 172.21.15.121:0/1331450891 >> 172.21.15.121:0/1331450891 conn(0x636770 msgr2=0x7146f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:51:44.089 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.089+0000 7ff2dc4feec0 1 -- 172.21.15.121:0/1331450891 shutdown_connections 2024-09-16T07:51:44.089 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.089+0000 7ff2dc4feec0 1 -- 172.21.15.121:0/1331450891 wait complete. 2024-09-16T07:51:44.090 INFO:tasks.workunit.client.0.smithi121.stderr:+ for f in `seq 1 10` 2024-09-16T07:51:44.090 INFO:tasks.workunit.client.0.smithi121.stderr:+ rados -p d3276ed3-e996-4bbc-b28e-567739f7faa8 put obj9 /etc/passwd 2024-09-16T07:51:44.127 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.127+0000 7f37d2c2fec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:44.131 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.132+0000 7f37d2c2fec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:44.131 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.132+0000 7f37d2c2fec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:44.131 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.133+0000 7f37d2c2fec0 1 Processor -- start 2024-09-16T07:51:44.131 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.133+0000 7f37d2c2fec0 1 -- start start 2024-09-16T07:51:44.134 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.134+0000 7f37d2c2fec0 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x957fc0 0xa7ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:51:44.135 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.134+0000 7f37d2c2fec0 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x8c4520 con 0x957fc0 2024-09-16T07:51:44.135 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.134+0000 7f37cac3f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x957fc0 0xa7ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:51:44.135 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.134+0000 7f37cac3f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x957fc0 0xa7ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:52094/0 (socket says 172.21.15.121:52094) 2024-09-16T07:51:44.135 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.134+0000 7f37cac3f640 1 -- 172.21.15.121:0/1718159115 learned_addr learned my addr 172.21.15.121:0/1718159115 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:51:44.135 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.134+0000 7f37cac3f640 1 -- 172.21.15.121:0/1718159115 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x860e10 con 0x957fc0 2024-09-16T07:51:44.135 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.134+0000 7f37cac3f640 1 --2- 172.21.15.121:0/1718159115 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x957fc0 0xa7ab30 crc :-1 s=READY pgs=12970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=467a25d960ae4a9d server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:51:44.135 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.134+0000 7f37c943c640 1 -- 172.21.15.121:0/1718159115 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f37b400b580 con 0x957fc0 2024-09-16T07:51:44.135 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.134+0000 7f37c943c640 1 -- 172.21.15.121:0/1718159115 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f37b400b6e0 con 0x957fc0 2024-09-16T07:51:44.135 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.134+0000 7f37c943c640 1 -- 172.21.15.121:0/1718159115 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f37b400b980 con 0x957fc0 2024-09-16T07:51:44.135 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.135+0000 7f37d2c2fec0 1 -- 172.21.15.121:0/1718159115 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x957fc0 msgr2=0xa7ab30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:51:44.135 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.135+0000 7f37d2c2fec0 1 --2- 172.21.15.121:0/1718159115 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x957fc0 0xa7ab30 crc :-1 s=READY pgs=12970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:44.135 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.135+0000 7f37d2c2fec0 1 -- 172.21.15.121:0/1718159115 shutdown_connections 2024-09-16T07:51:44.136 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.135+0000 7f37d2c2fec0 1 --2- 172.21.15.121:0/1718159115 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x957fc0 0xa7ab30 unknown :-1 s=CLOSED pgs=12970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:44.136 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.135+0000 7f37d2c2fec0 1 -- 172.21.15.121:0/1718159115 >> 172.21.15.121:0/1718159115 conn(0x884770 msgr2=0x959700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:51:44.136 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.135+0000 7f37d2c2fec0 1 -- 172.21.15.121:0/1718159115 shutdown_connections 2024-09-16T07:51:44.136 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.135+0000 7f37d2c2fec0 1 -- 172.21.15.121:0/1718159115 wait complete. 2024-09-16T07:51:44.136 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.136+0000 7f37d2c2fec0 1 Processor -- start 2024-09-16T07:51:44.136 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.136+0000 7f37d2c2fec0 1 -- start start 2024-09-16T07:51:44.138 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.137+0000 7f37d2c2fec0 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x957fc0 0xa60550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:51:44.138 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.137+0000 7f37d2c2fec0 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x8c2280 con 0x957fc0 2024-09-16T07:51:44.138 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.137+0000 7f37cac3f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x957fc0 0xa60550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:51:44.138 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.137+0000 7f37cac3f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x957fc0 0xa60550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:52102/0 (socket says 172.21.15.121:52102) 2024-09-16T07:51:44.138 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.137+0000 7f37cac3f640 1 -- 172.21.15.121:0/2396280207 learned_addr learned my addr 172.21.15.121:0/2396280207 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:51:44.138 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.137+0000 7f37cac3f640 1 -- 172.21.15.121:0/2396280207 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x852920 con 0x957fc0 2024-09-16T07:51:44.138 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.137+0000 7f37cac3f640 1 --2- 172.21.15.121:0/2396280207 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x957fc0 0xa60550 crc :-1 s=READY pgs=12971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:51:44.138 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.137+0000 7f37c37fe640 1 -- 172.21.15.121:0/2396280207 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f37b40129c0 con 0x957fc0 2024-09-16T07:51:44.138 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.138+0000 7f37c37fe640 1 -- 172.21.15.121:0/2396280207 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f37b4005040 con 0x957fc0 2024-09-16T07:51:44.139 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.138+0000 7f37d2c2fec0 1 -- 172.21.15.121:0/2396280207 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x852380 con 0x957fc0 2024-09-16T07:51:44.139 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.138+0000 7f37c37fe640 1 -- 172.21.15.121:0/2396280207 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f37b4012c50 con 0x957fc0 2024-09-16T07:51:44.139 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.138+0000 7f37d2c2fec0 1 -- 172.21.15.121:0/2396280207 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0xa63360 con 0x957fc0 2024-09-16T07:51:44.139 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.138+0000 7f37c37fe640 1 -- 172.21.15.121:0/2396280207 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f37b400d040 con 0x957fc0 2024-09-16T07:51:44.139 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.139+0000 7f37c37fe640 1 --2- 172.21.15.121:0/2396280207 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f37b003f3d0 0x7f37b00418e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:51:44.139 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.139+0000 7f37c37fe640 1 -- 172.21.15.121:0/2396280207 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(715..715 src has 620..715) ==== 4207+0+0 (crc 0 0 0) 0x7f37b400a040 con 0x957fc0 2024-09-16T07:51:44.139 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.139+0000 7f37d2c2fec0 1 --2- 172.21.15.121:0/2396280207 >> v2:172.21.15.172:6808/3418488586 conn(0x960300 0xa79340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:51:44.139 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.139+0000 7f37d2c2fec0 1 -- 172.21.15.121:0/2396280207 --> v2:172.21.15.172:6808/3418488586 -- osd_op(unknown.0.0:1 200.7 200:fe351e27:::obj9:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e715) -- 0xa638c0 con 0x960300 2024-09-16T07:51:44.139 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.139+0000 7f37ca43e640 1 --2- 172.21.15.121:0/2396280207 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f37b003f3d0 0x7f37b00418e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:51:44.140 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.140+0000 7f37ca43e640 1 --2- 172.21.15.121:0/2396280207 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f37b003f3d0 0x7f37b00418e0 crc :-1 s=READY pgs=3837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:51:44.140 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.140+0000 7f37cb440640 1 --2- 172.21.15.121:0/2396280207 >> v2:172.21.15.172:6808/3418488586 conn(0x960300 0xa79340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T07:51:44.142 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.144+0000 7f37cb440640 1 --2- 172.21.15.121:0/2396280207 >> v2:172.21.15.172:6808/3418488586 conn(0x960300 0xa79340 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:51:44.158 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.158+0000 7f37cb440640 1 -- 172.21.15.121:0/2396280207 <== osd.3 v2:172.21.15.172:6808/3418488586 1 ==== osd_op_reply(1 obj9 [writefull 0~12875] v715'2 uv2 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f37bc00a430 con 0x960300 2024-09-16T07:51:44.158 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.158+0000 7f37d2c2fec0 1 -- 172.21.15.121:0/2396280207 >> v2:172.21.15.172:6808/3418488586 conn(0x960300 msgr2=0xa79340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:51:44.158 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.158+0000 7f37d2c2fec0 1 --2- 172.21.15.121:0/2396280207 >> v2:172.21.15.172:6808/3418488586 conn(0x960300 0xa79340 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:44.158 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.158+0000 7f37d2c2fec0 1 -- 172.21.15.121:0/2396280207 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f37b003f3d0 msgr2=0x7f37b00418e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:51:44.159 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.158+0000 7f37d2c2fec0 1 --2- 172.21.15.121:0/2396280207 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f37b003f3d0 0x7f37b00418e0 crc :-1 s=READY pgs=3837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:44.159 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.158+0000 7f37d2c2fec0 1 -- 172.21.15.121:0/2396280207 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x957fc0 msgr2=0xa60550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:51:44.159 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.158+0000 7f37d2c2fec0 1 --2- 172.21.15.121:0/2396280207 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x957fc0 0xa60550 crc :-1 s=READY pgs=12971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:44.159 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.158+0000 7f37d2c2fec0 1 -- 172.21.15.121:0/2396280207 shutdown_connections 2024-09-16T07:51:44.159 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.158+0000 7f37d2c2fec0 1 --2- 172.21.15.121:0/2396280207 >> v2:172.21.15.172:6808/3418488586 conn(0x960300 0xa79340 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:44.159 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.158+0000 7f37d2c2fec0 1 --2- 172.21.15.121:0/2396280207 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f37b003f3d0 0x7f37b00418e0 unknown :-1 s=CLOSED pgs=3837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:44.159 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.158+0000 7f37d2c2fec0 1 --2- 172.21.15.121:0/2396280207 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x957fc0 0xa60550 unknown :-1 s=CLOSED pgs=12971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:44.159 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.158+0000 7f37d2c2fec0 1 -- 172.21.15.121:0/2396280207 >> 172.21.15.121:0/2396280207 conn(0x884770 msgr2=0x959700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:51:44.159 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.158+0000 7f37d2c2fec0 1 -- 172.21.15.121:0/2396280207 shutdown_connections 2024-09-16T07:51:44.160 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.158+0000 7f37d2c2fec0 1 -- 172.21.15.121:0/2396280207 wait complete. 2024-09-16T07:51:44.161 INFO:tasks.workunit.client.0.smithi121.stderr:+ for f in `seq 1 10` 2024-09-16T07:51:44.161 INFO:tasks.workunit.client.0.smithi121.stderr:+ rados -p d3276ed3-e996-4bbc-b28e-567739f7faa8 put obj10 /etc/passwd 2024-09-16T07:51:44.195 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.196+0000 7f9df0548ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:44.200 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.201+0000 7f9df0548ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:44.200 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.201+0000 7f9df0548ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:44.201 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.202+0000 7f9df0548ec0 1 Processor -- start 2024-09-16T07:51:44.201 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.202+0000 7f9df0548ec0 1 -- start start 2024-09-16T07:51:44.202 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.203+0000 7f9df0548ec0 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xefe300 0x1016590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:51:44.202 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.203+0000 7f9df0548ec0 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0xe62520 con 0xefe300 2024-09-16T07:51:44.202 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.203+0000 7f9de883f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xefe300 0x1016590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:51:44.203 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.203+0000 7f9de883f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xefe300 0x1016590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:52124/0 (socket says 172.21.15.121:52124) 2024-09-16T07:51:44.203 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.203+0000 7f9de883f640 1 -- 172.21.15.121:0/3532427210 learned_addr learned my addr 172.21.15.121:0/3532427210 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:51:44.203 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.203+0000 7f9de883f640 1 -- 172.21.15.121:0/3532427210 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xdfee10 con 0xefe300 2024-09-16T07:51:44.203 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.203+0000 7f9de883f640 1 --2- 172.21.15.121:0/3532427210 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xefe300 0x1016590 crc :-1 s=READY pgs=12974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b71e153b53925eb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:51:44.203 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.204+0000 7f9de2ffd640 1 -- 172.21.15.121:0/3532427210 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9dd402dc20 con 0xefe300 2024-09-16T07:51:44.203 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.204+0000 7f9de2ffd640 1 -- 172.21.15.121:0/3532427210 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f9dd4037370 con 0xefe300 2024-09-16T07:51:44.203 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.204+0000 7f9de2ffd640 1 -- 172.21.15.121:0/3532427210 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9dd4037610 con 0xefe300 2024-09-16T07:51:44.204 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.204+0000 7f9df0548ec0 1 -- 172.21.15.121:0/3532427210 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xefe300 msgr2=0x1016590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:51:44.204 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.204+0000 7f9df0548ec0 1 --2- 172.21.15.121:0/3532427210 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xefe300 0x1016590 crc :-1 s=READY pgs=12974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:44.204 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.204+0000 7f9df0548ec0 1 -- 172.21.15.121:0/3532427210 shutdown_connections 2024-09-16T07:51:44.204 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.204+0000 7f9df0548ec0 1 --2- 172.21.15.121:0/3532427210 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xefe300 0x1016590 unknown :-1 s=CLOSED pgs=12974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:44.204 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.204+0000 7f9df0548ec0 1 -- 172.21.15.121:0/3532427210 >> 172.21.15.121:0/3532427210 conn(0xe22770 msgr2=0xf006f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:51:44.204 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.204+0000 7f9df0548ec0 1 -- 172.21.15.121:0/3532427210 shutdown_connections 2024-09-16T07:51:44.204 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.204+0000 7f9df0548ec0 1 -- 172.21.15.121:0/3532427210 wait complete. 2024-09-16T07:51:44.204 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.205+0000 7f9df0548ec0 1 Processor -- start 2024-09-16T07:51:44.205 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.205+0000 7f9df0548ec0 1 -- start start 2024-09-16T07:51:44.206 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.206+0000 7f9df0548ec0 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xefe300 0xf8cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:51:44.206 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.206+0000 7f9df0548ec0 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0xe60280 con 0xefe300 2024-09-16T07:51:44.206 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.206+0000 7f9de883f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xefe300 0xf8cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:51:44.206 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.206+0000 7f9de883f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xefe300 0xf8cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:52130/0 (socket says 172.21.15.121:52130) 2024-09-16T07:51:44.206 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.206+0000 7f9de883f640 1 -- 172.21.15.121:0/1880629463 learned_addr learned my addr 172.21.15.121:0/1880629463 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:51:44.206 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.206+0000 7f9de883f640 1 -- 172.21.15.121:0/1880629463 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xdf0920 con 0xefe300 2024-09-16T07:51:44.206 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.207+0000 7f9de883f640 1 --2- 172.21.15.121:0/1880629463 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xefe300 0xf8cb80 crc :-1 s=READY pgs=12975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:51:44.206 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.207+0000 7f9de1ffb640 1 -- 172.21.15.121:0/1880629463 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9dd403e040 con 0xefe300 2024-09-16T07:51:44.206 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.207+0000 7f9de1ffb640 1 -- 172.21.15.121:0/1880629463 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f9dd402daf0 con 0xefe300 2024-09-16T07:51:44.206 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.207+0000 7f9df0548ec0 1 -- 172.21.15.121:0/1880629463 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0xdf0380 con 0xefe300 2024-09-16T07:51:44.207 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.207+0000 7f9de1ffb640 1 -- 172.21.15.121:0/1880629463 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9dd4037e20 con 0xefe300 2024-09-16T07:51:44.207 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.207+0000 7f9df0548ec0 1 -- 172.21.15.121:0/1880629463 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0xf7d660 con 0xefe300 2024-09-16T07:51:44.208 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.208+0000 7f9de1ffb640 1 -- 172.21.15.121:0/1880629463 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f9dd4041040 con 0xefe300 2024-09-16T07:51:44.208 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.208+0000 7f9de1ffb640 1 --2- 172.21.15.121:0/1880629463 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f9dd003d1c0 0x7f9dd003f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:51:44.208 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.208+0000 7f9de1ffb640 1 -- 172.21.15.121:0/1880629463 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(715..715 src has 620..715) ==== 4207+0+0 (crc 0 0 0) 0x7f9dd4032040 con 0xefe300 2024-09-16T07:51:44.208 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.208+0000 7f9df0548ec0 1 --2- 172.21.15.121:0/1880629463 >> v2:172.21.15.121:6808/3193900849 conn(0xf90a60 0xf79f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:51:44.208 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.208+0000 7f9df0548ec0 1 -- 172.21.15.121:0/1880629463 --> v2:172.21.15.121:6808/3193900849 -- osd_op(unknown.0.0:1 200.b 200:d1337354:::obj10:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e715) -- 0xf7c9f0 con 0xf90a60 2024-09-16T07:51:44.208 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.208+0000 7f9de3fff640 1 --2- 172.21.15.121:0/1880629463 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f9dd003d1c0 0x7f9dd003f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:51:44.208 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.209+0000 7f9de3fff640 1 --2- 172.21.15.121:0/1880629463 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f9dd003d1c0 0x7f9dd003f6d0 crc :-1 s=READY pgs=3838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:51:44.208 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.209+0000 7f9de9040640 1 --2- 172.21.15.121:0/1880629463 >> v2:172.21.15.121:6808/3193900849 conn(0xf90a60 0xf79f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T07:51:44.211 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.212+0000 7f9de9040640 1 --2- 172.21.15.121:0/1880629463 >> v2:172.21.15.121:6808/3193900849 conn(0xf90a60 0xf79f90 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:51:44.225 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.226+0000 7f9de9040640 1 -- 172.21.15.121:0/1880629463 <== osd.0 v2:172.21.15.121:6808/3193900849 1 ==== osd_op_reply(1 obj10 [writefull 0~12875] v715'1 uv1 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f9ddc00a430 con 0xf90a60 2024-09-16T07:51:44.225 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.226+0000 7f9df0548ec0 1 -- 172.21.15.121:0/1880629463 >> v2:172.21.15.121:6808/3193900849 conn(0xf90a60 msgr2=0xf79f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:51:44.226 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.226+0000 7f9df0548ec0 1 --2- 172.21.15.121:0/1880629463 >> v2:172.21.15.121:6808/3193900849 conn(0xf90a60 0xf79f90 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:44.226 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.226+0000 7f9df0548ec0 1 -- 172.21.15.121:0/1880629463 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f9dd003d1c0 msgr2=0x7f9dd003f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:51:44.226 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.226+0000 7f9df0548ec0 1 --2- 172.21.15.121:0/1880629463 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f9dd003d1c0 0x7f9dd003f6d0 crc :-1 s=READY pgs=3838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:44.226 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.226+0000 7f9df0548ec0 1 -- 172.21.15.121:0/1880629463 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xefe300 msgr2=0xf8cb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:51:44.226 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.226+0000 7f9df0548ec0 1 --2- 172.21.15.121:0/1880629463 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xefe300 0xf8cb80 crc :-1 s=READY pgs=12975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:44.226 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.226+0000 7f9df0548ec0 1 -- 172.21.15.121:0/1880629463 shutdown_connections 2024-09-16T07:51:44.226 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.226+0000 7f9df0548ec0 1 --2- 172.21.15.121:0/1880629463 >> v2:172.21.15.121:6808/3193900849 conn(0xf90a60 0xf79f90 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:44.226 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.226+0000 7f9df0548ec0 1 --2- 172.21.15.121:0/1880629463 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f9dd003d1c0 0x7f9dd003f6d0 unknown :-1 s=CLOSED pgs=3838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:44.226 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.226+0000 7f9df0548ec0 1 --2- 172.21.15.121:0/1880629463 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xefe300 0xf8cb80 unknown :-1 s=CLOSED pgs=12975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:51:44.226 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.226+0000 7f9df0548ec0 1 -- 172.21.15.121:0/1880629463 >> 172.21.15.121:0/1880629463 conn(0xe22770 msgr2=0x1016590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:51:44.226 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.226+0000 7f9df0548ec0 1 -- 172.21.15.121:0/1880629463 shutdown_connections 2024-09-16T07:51:44.226 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:51:44.226+0000 7f9df0548ec0 1 -- 172.21.15.121:0/1880629463 wait complete. 2024-09-16T07:51:44.227 INFO:tasks.workunit.client.0.smithi121.stderr:+ sleep 30 2024-09-16T07:52:14.230 INFO:tasks.workunit.client.0.smithi121.stderr:+ rados -p 989b9542-ea3d-4c5c-8f96-23ff25b76fb1 put threemore /etc/passwd 2024-09-16T07:52:14.274 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.275+0000 7f1e826efec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:14.279 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.280+0000 7f1e826efec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:14.280 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.280+0000 7f1e826efec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:14.280 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.280+0000 7f1e826efec0 1 Processor -- start 2024-09-16T07:52:14.280 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.280+0000 7f1e826efec0 1 -- start start 2024-09-16T07:52:14.282 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.281+0000 7f1e826efec0 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xe85fc0 0xe73d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:52:14.282 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.281+0000 7f1e826efec0 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0xdf2520 con 0xe85fc0 2024-09-16T07:52:14.282 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.282+0000 7f1e7aa3f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xe85fc0 0xe73d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:52:14.282 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.282+0000 7f1e7aa3f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xe85fc0 0xe73d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39362/0 (socket says 172.21.15.121:39362) 2024-09-16T07:52:14.282 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.282+0000 7f1e7aa3f640 1 -- 172.21.15.121:0/246751806 learned_addr learned my addr 172.21.15.121:0/246751806 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:52:14.282 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.282+0000 7f1e7aa3f640 1 -- 172.21.15.121:0/246751806 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xd8ee10 con 0xe85fc0 2024-09-16T07:52:14.282 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.282+0000 7f1e7aa3f640 1 --2- 172.21.15.121:0/246751806 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xe85fc0 0xe73d80 crc :-1 s=READY pgs=12978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57b610a10524921b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:52:14.282 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.282+0000 7f1e7923c640 1 -- 172.21.15.121:0/246751806 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1e6402dcc0 con 0xe85fc0 2024-09-16T07:52:14.283 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.282+0000 7f1e7923c640 1 -- 172.21.15.121:0/246751806 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1e64037370 con 0xe85fc0 2024-09-16T07:52:14.283 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.282+0000 7f1e7923c640 1 -- 172.21.15.121:0/246751806 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1e64037610 con 0xe85fc0 2024-09-16T07:52:14.284 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.283+0000 7f1e826efec0 1 -- 172.21.15.121:0/246751806 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xe85fc0 msgr2=0xe73d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:52:14.284 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.283+0000 7f1e826efec0 1 --2- 172.21.15.121:0/246751806 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xe85fc0 0xe73d80 crc :-1 s=READY pgs=12978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:14.284 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.283+0000 7f1e826efec0 1 -- 172.21.15.121:0/246751806 shutdown_connections 2024-09-16T07:52:14.284 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.283+0000 7f1e826efec0 1 --2- 172.21.15.121:0/246751806 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xe85fc0 0xe73d80 unknown :-1 s=CLOSED pgs=12978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:14.284 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.283+0000 7f1e826efec0 1 -- 172.21.15.121:0/246751806 >> 172.21.15.121:0/246751806 conn(0xdb2770 msgr2=0xe87700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:52:14.284 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.283+0000 7f1e826efec0 1 -- 172.21.15.121:0/246751806 shutdown_connections 2024-09-16T07:52:14.284 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.283+0000 7f1e826efec0 1 -- 172.21.15.121:0/246751806 wait complete. 2024-09-16T07:52:14.284 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.284+0000 7f1e826efec0 1 Processor -- start 2024-09-16T07:52:14.284 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.284+0000 7f1e826efec0 1 -- start start 2024-09-16T07:52:14.286 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.285+0000 7f1e826efec0 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xe85fc0 0xf92770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:52:14.286 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.285+0000 7f1e826efec0 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0xdf0280 con 0xe85fc0 2024-09-16T07:52:14.286 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.285+0000 7f1e7aa3f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xe85fc0 0xf92770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:52:14.286 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.285+0000 7f1e7aa3f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xe85fc0 0xf92770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39374/0 (socket says 172.21.15.121:39374) 2024-09-16T07:52:14.286 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.285+0000 7f1e7aa3f640 1 -- 172.21.15.121:0/2403530299 learned_addr learned my addr 172.21.15.121:0/2403530299 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:52:14.286 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.285+0000 7f1e7aa3f640 1 -- 172.21.15.121:0/2403530299 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xd80920 con 0xe85fc0 2024-09-16T07:52:14.286 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.285+0000 7f1e7aa3f640 1 --2- 172.21.15.121:0/2403530299 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xe85fc0 0xf92770 crc :-1 s=READY pgs=12979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:52:14.286 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.285+0000 7f1e737fe640 1 -- 172.21.15.121:0/2403530299 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1e6403e040 con 0xe85fc0 2024-09-16T07:52:14.286 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.285+0000 7f1e737fe640 1 -- 172.21.15.121:0/2403530299 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1e6402db90 con 0xe85fc0 2024-09-16T07:52:14.286 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.285+0000 7f1e826efec0 1 -- 172.21.15.121:0/2403530299 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0xd80380 con 0xe85fc0 2024-09-16T07:52:14.286 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.285+0000 7f1e737fe640 1 -- 172.21.15.121:0/2403530299 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1e64037d50 con 0xe85fc0 2024-09-16T07:52:14.287 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.286+0000 7f1e826efec0 1 -- 172.21.15.121:0/2403530299 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0xf95510 con 0xe85fc0 2024-09-16T07:52:14.288 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.286+0000 7f1e737fe640 1 -- 172.21.15.121:0/2403530299 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f1e64041040 con 0xe85fc0 2024-09-16T07:52:14.288 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.287+0000 7f1e737fe640 1 --2- 172.21.15.121:0/2403530299 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f1e6003d1c0 0x7f1e6003f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:52:14.288 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.287+0000 7f1e737fe640 1 -- 172.21.15.121:0/2403530299 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(717..717 src has 620..717) ==== 4207+0+0 (crc 0 0 0) 0x7f1e64032040 con 0xe85fc0 2024-09-16T07:52:14.288 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.287+0000 7f1e737fe640 1 -- 172.21.15.121:0/2403530299 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=718}) -- 0x7f1e60043c50 con 0xe85fc0 2024-09-16T07:52:14.288 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.287+0000 7f1e826efec0 1 --2- 172.21.15.121:0/2403530299 >> v2:172.21.15.172:6804/2274906412 conn(0xe8e130 0xfaa810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:52:14.288 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.287+0000 7f1e826efec0 1 -- 172.21.15.121:0/2403530299 --> v2:172.21.15.172:6804/2274906412 -- osd_op(unknown.0.0:1 199.2 199:47cad802:::threemore:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e717) -- 0xf95ca0 con 0xe8e130 2024-09-16T07:52:14.288 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.287+0000 7f1e7a23e640 1 --2- 172.21.15.121:0/2403530299 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f1e6003d1c0 0x7f1e6003f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:52:14.288 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.288+0000 7f1e7a23e640 1 --2- 172.21.15.121:0/2403530299 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f1e6003d1c0 0x7f1e6003f6d0 crc :-1 s=READY pgs=3839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:52:14.289 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.288+0000 7f1e7b240640 1 --2- 172.21.15.121:0/2403530299 >> v2:172.21.15.172:6804/2274906412 conn(0xe8e130 0xfaa810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T07:52:14.292 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.294+0000 7f1e7b240640 1 --2- 172.21.15.121:0/2403530299 >> v2:172.21.15.172:6804/2274906412 conn(0xe8e130 0xfaa810 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:52:14.313 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.313+0000 7f1e7b240640 1 -- 172.21.15.121:0/2403530299 <== osd.2 v2:172.21.15.172:6804/2274906412 1 ==== osd_op_reply(1 threemore [writefull 0~12875] v717'1 uv1 ondisk = 0) ==== 153+0+0 (crc 0 0 0) 0x7f1e6c00a430 con 0xe8e130 2024-09-16T07:52:14.313 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.313+0000 7f1e826efec0 1 -- 172.21.15.121:0/2403530299 >> v2:172.21.15.172:6804/2274906412 conn(0xe8e130 msgr2=0xfaa810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:52:14.313 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.313+0000 7f1e826efec0 1 --2- 172.21.15.121:0/2403530299 >> v2:172.21.15.172:6804/2274906412 conn(0xe8e130 0xfaa810 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:14.313 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.313+0000 7f1e826efec0 1 -- 172.21.15.121:0/2403530299 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f1e6003d1c0 msgr2=0x7f1e6003f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:52:14.313 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.313+0000 7f1e826efec0 1 --2- 172.21.15.121:0/2403530299 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f1e6003d1c0 0x7f1e6003f6d0 crc :-1 s=READY pgs=3839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:14.313 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.313+0000 7f1e826efec0 1 -- 172.21.15.121:0/2403530299 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xe85fc0 msgr2=0xf92770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:52:14.313 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.313+0000 7f1e826efec0 1 --2- 172.21.15.121:0/2403530299 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xe85fc0 0xf92770 crc :-1 s=READY pgs=12979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:14.313 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.313+0000 7f1e826efec0 1 -- 172.21.15.121:0/2403530299 shutdown_connections 2024-09-16T07:52:14.313 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.313+0000 7f1e826efec0 1 --2- 172.21.15.121:0/2403530299 >> v2:172.21.15.172:6804/2274906412 conn(0xe8e130 0xfaa810 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:14.313 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.313+0000 7f1e826efec0 1 --2- 172.21.15.121:0/2403530299 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f1e6003d1c0 0x7f1e6003f6d0 unknown :-1 s=CLOSED pgs=3839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:14.314 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.313+0000 7f1e826efec0 1 --2- 172.21.15.121:0/2403530299 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0xe85fc0 0xf92770 unknown :-1 s=CLOSED pgs=12979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:14.314 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.313+0000 7f1e826efec0 1 -- 172.21.15.121:0/2403530299 >> 172.21.15.121:0/2403530299 conn(0xdb2770 msgr2=0xe73d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:52:14.314 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.313+0000 7f1e826efec0 1 -- 172.21.15.121:0/2403530299 shutdown_connections 2024-09-16T07:52:14.314 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.313+0000 7f1e826efec0 1 -- 172.21.15.121:0/2403530299 wait complete. 2024-09-16T07:52:14.315 INFO:tasks.workunit.client.0.smithi121.stderr:+ ceph osd pool set-quota 989b9542-ea3d-4c5c-8f96-23ff25b76fb1 max_bytes 0 2024-09-16T07:52:14.410 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.403+0000 7f7340ac8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:14.411 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.411+0000 7f7340ac8640 1 Processor -- start 2024-09-16T07:52:14.411 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.411+0000 7f7340ac8640 1 -- start start 2024-09-16T07:52:14.413 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.412+0000 7f7340ac8640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f733c0a0290 0x7f733c0a06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:52:14.413 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.413+0000 7f7340ac8640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f733c0a12e0 con 0x7f733c0a0be0 2024-09-16T07:52:14.413 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.413+0000 7f7340ac8640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f733c071790 con 0x7f733c0a0290 2024-09-16T07:52:14.413 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.413+0000 7f733a59c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f733c0a0290 0x7f733c0a06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:52:14.413 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.413+0000 7f733a59c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f733c0a0290 0x7f733c0a06a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39386/0 (socket says 172.21.15.121:39386) 2024-09-16T07:52:14.414 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.413+0000 7f733a59c640 1 -- 172.21.15.121:0/182650025 learned_addr learned my addr 172.21.15.121:0/182650025 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:52:14.414 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.413+0000 7f7331d9b640 1 --1- 172.21.15.121:0/182650025 >> v1:172.21.15.121:6789/0 conn(0x7f733c0a0be0 0x7f733c133f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:59178/0 (socket says 172.21.15.121:59178) 2024-09-16T07:52:14.414 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.413+0000 7f733a59c640 1 -- 172.21.15.121:0/182650025 >> v1:172.21.15.121:6789/0 conn(0x7f733c0a0be0 legacy=0x7f733c133f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:52:14.414 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.413+0000 7f7339d9b640 1 -- 172.21.15.121:0/182650025 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3812500058 0 0) 0x7f733c0a12e0 con 0x7f733c0a0be0 2024-09-16T07:52:14.414 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.413+0000 7f733a59c640 1 -- 172.21.15.121:0/182650025 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f733c0a1c80 con 0x7f733c0a0290 2024-09-16T07:52:14.414 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.413+0000 7f733a59c640 1 --2- 172.21.15.121:0/182650025 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f733c0a0290 0x7f733c0a06a0 crc :-1 s=READY pgs=12981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50065a0a61eabf38 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:52:14.414 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.413+0000 7f7339d9b640 1 -- 172.21.15.121:0/182650025 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f732c009e50 con 0x7f733c0a0290 2024-09-16T07:52:14.414 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.413+0000 7f7339d9b640 1 -- 172.21.15.121:0/182650025 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f732c00e230 con 0x7f733c0a0290 2024-09-16T07:52:14.414 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.413+0000 7f7339d9b640 1 -- 172.21.15.121:0/182650025 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f732c00e4d0 con 0x7f733c0a0290 2024-09-16T07:52:14.415 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.414+0000 7f7340ac8640 1 -- 172.21.15.121:0/182650025 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f733c0a0290 msgr2=0x7f733c0a06a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:52:14.415 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.414+0000 7f7340ac8640 1 --2- 172.21.15.121:0/182650025 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f733c0a0290 0x7f733c0a06a0 crc :-1 s=READY pgs=12981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:14.415 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.414+0000 7f7340ac8640 1 -- 172.21.15.121:0/182650025 shutdown_connections 2024-09-16T07:52:14.415 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.414+0000 7f7340ac8640 1 --2- 172.21.15.121:0/182650025 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f733c0a0290 0x7f733c0a06a0 unknown :-1 s=CLOSED pgs=12981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:14.415 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.414+0000 7f7340ac8640 1 -- 172.21.15.121:0/182650025 >> 172.21.15.121:0/182650025 conn(0x7f733c09d9e0 msgr2=0x7f733c09ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:52:14.415 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.414+0000 7f7340ac8640 1 -- 172.21.15.121:0/182650025 shutdown_connections 2024-09-16T07:52:14.416 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.414+0000 7f7340ac8640 1 -- 172.21.15.121:0/182650025 wait complete. 2024-09-16T07:52:14.416 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.414+0000 7f7340ac8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:14.416 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.416+0000 7f7340ac8640 1 Processor -- start 2024-09-16T07:52:14.416 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.416+0000 7f7340ac8640 1 -- start start 2024-09-16T07:52:14.417 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.417+0000 7f7340ac8640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f733c0a0290 0x7f733c1c8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:52:14.418 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.417+0000 7f7340ac8640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f733c123e00 con 0x7f733c0a0290 2024-09-16T07:52:14.418 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.417+0000 7f733a59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f733c0a0290 0x7f733c1c8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:52:14.418 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.417+0000 7f733a59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f733c0a0290 0x7f733c1c8590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39398/0 (socket says 172.21.15.121:39398) 2024-09-16T07:52:14.418 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.417+0000 7f733a59c640 1 -- 172.21.15.121:0/1943131842 learned_addr learned my addr 172.21.15.121:0/1943131842 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:52:14.418 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.417+0000 7f733a59c640 1 -- 172.21.15.121:0/1943131842 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f733c1263a0 con 0x7f733c0a0290 2024-09-16T07:52:14.418 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.418+0000 7f733a59c640 1 --2- 172.21.15.121:0/1943131842 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f733c0a0290 0x7f733c1c8590 crc :-1 s=READY pgs=12982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:52:14.418 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.418+0000 7f73337fe640 1 -- 172.21.15.121:0/1943131842 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f732c00edc0 con 0x7f733c0a0290 2024-09-16T07:52:14.418 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.418+0000 7f73337fe640 1 -- 172.21.15.121:0/1943131842 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f732c015420 con 0x7f733c0a0290 2024-09-16T07:52:14.418 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.418+0000 7f7340ac8640 1 -- 172.21.15.121:0/1943131842 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f733c070e30 con 0x7f733c0a0290 2024-09-16T07:52:14.418 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.418+0000 7f73337fe640 1 -- 172.21.15.121:0/1943131842 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f732c0156c0 con 0x7f733c0a0290 2024-09-16T07:52:14.418 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.418+0000 7f7340ac8640 1 -- 172.21.15.121:0/1943131842 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f733c0a41d0 con 0x7f733c0a0290 2024-09-16T07:52:14.419 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.419+0000 7f73337fe640 1 -- 172.21.15.121:0/1943131842 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f732c0158c0 con 0x7f733c0a0290 2024-09-16T07:52:14.419 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.419+0000 7f7340ac8640 1 -- 172.21.15.121:0/1943131842 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f733c0a43b0 con 0x7f733c0a0290 2024-09-16T07:52:14.419 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.419+0000 7f73337fe640 1 --2- 172.21.15.121:0/1943131842 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f731c03e8e0 0x7f731c040df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:52:14.419 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.419+0000 7f73337fe640 1 -- 172.21.15.121:0/1943131842 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(717..717 src has 620..717) ==== 4207+0+0 (crc 0 0 0) 0x7f732c051310 con 0x7f733c0a0290 2024-09-16T07:52:14.419 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.419+0000 7f73337fe640 1 -- 172.21.15.121:0/1943131842 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=718}) -- 0x7f731c045310 con 0x7f733c0a0290 2024-09-16T07:52:14.420 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.419+0000 7f7331d9b640 1 --2- 172.21.15.121:0/1943131842 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f731c03e8e0 0x7f731c040df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:52:14.420 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.420+0000 7f7331d9b640 1 --2- 172.21.15.121:0/1943131842 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f731c03e8e0 0x7f731c040df0 crc :-1 s=READY pgs=3840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:52:14.424 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.424+0000 7f73337fe640 1 -- 172.21.15.121:0/1943131842 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f733c0a43b0 con 0x7f733c0a0290 2024-09-16T07:52:14.602 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:14.602+0000 7f7340ac8640 1 -- 172.21.15.121:0/1943131842 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "989b9542-ea3d-4c5c-8f96-23ff25b76fb1", "field": "max_bytes", "val": "0"} v 0) -- 0x7f733c071b20 con 0x7f733c0a0290 2024-09-16T07:52:15.513 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:15.514+0000 7f73337fe640 1 -- 172.21.15.121:0/1943131842 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "989b9542-ea3d-4c5c-8f96-23ff25b76fb1", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool 989b9542-ea3d-4c5c-8f96-23ff25b76fb1 v718) ==== 217+0+0 (crc 0 0 0) 0x7f732c014c60 con 0x7f733c0a0290 2024-09-16T07:52:15.513 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:15.515+0000 7f73337fe640 1 -- 172.21.15.121:0/1943131842 <== mon.0 v2:172.21.15.121:3300/0 8 ==== osd_map(718..718 src has 620..718) ==== 628+0+0 (crc 0 0 0) 0x7f732c011e00 con 0x7f733c0a0290 2024-09-16T07:52:15.513 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:15.515+0000 7f73337fe640 1 -- 172.21.15.121:0/1943131842 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=719}) -- 0x7f731c046090 con 0x7f733c0a0290 2024-09-16T07:52:15.636 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:15.637+0000 7f7340ac8640 1 -- 172.21.15.121:0/1943131842 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "989b9542-ea3d-4c5c-8f96-23ff25b76fb1", "field": "max_bytes", "val": "0"} v 0) -- 0x7f733c0a4360 con 0x7f733c0a0290 2024-09-16T07:52:16.514 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:16.515+0000 7f73337fe640 1 -- 172.21.15.121:0/1943131842 <== mon.0 v2:172.21.15.121:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "989b9542-ea3d-4c5c-8f96-23ff25b76fb1", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool 989b9542-ea3d-4c5c-8f96-23ff25b76fb1 v719) ==== 217+0+0 (crc 0 0 0) 0x7f732c0109c0 con 0x7f733c0a0290 2024-09-16T07:52:16.515 INFO:tasks.workunit.client.0.smithi121.stderr:set-quota max_bytes = 0 for pool 989b9542-ea3d-4c5c-8f96-23ff25b76fb1 2024-09-16T07:52:16.515 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:16.516+0000 7f73337fe640 1 -- 172.21.15.121:0/1943131842 <== mon.0 v2:172.21.15.121:3300/0 10 ==== osd_map(719..719 src has 620..719) ==== 628+0+0 (crc 0 0 0) 0x7f732c00fd80 con 0x7f733c0a0290 2024-09-16T07:52:16.515 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:16.516+0000 7f73337fe640 1 -- 172.21.15.121:0/1943131842 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=720}) -- 0x7f731c046500 con 0x7f733c0a0290 2024-09-16T07:52:16.518 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:16.519+0000 7f7340ac8640 1 -- 172.21.15.121:0/1943131842 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f731c03e8e0 msgr2=0x7f731c040df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:52:16.518 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:16.519+0000 7f7340ac8640 1 --2- 172.21.15.121:0/1943131842 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f731c03e8e0 0x7f731c040df0 crc :-1 s=READY pgs=3840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:16.518 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:16.519+0000 7f7340ac8640 1 -- 172.21.15.121:0/1943131842 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f733c0a0290 msgr2=0x7f733c1c8590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:52:16.518 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:16.519+0000 7f7340ac8640 1 --2- 172.21.15.121:0/1943131842 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f733c0a0290 0x7f733c1c8590 crc :-1 s=READY pgs=12982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:16.518 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:16.519+0000 7f7340ac8640 1 -- 172.21.15.121:0/1943131842 shutdown_connections 2024-09-16T07:52:16.519 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:16.519+0000 7f7340ac8640 1 --2- 172.21.15.121:0/1943131842 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f731c03e8e0 0x7f731c040df0 unknown :-1 s=CLOSED pgs=3840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:16.519 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:16.519+0000 7f7340ac8640 1 --2- 172.21.15.121:0/1943131842 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f733c0a0290 0x7f733c1c8590 unknown :-1 s=CLOSED pgs=12982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:16.519 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:16.519+0000 7f7340ac8640 1 -- 172.21.15.121:0/1943131842 >> 172.21.15.121:0/1943131842 conn(0x7f733c09d9e0 msgr2=0x7f733c11ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:52:16.519 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:16.520+0000 7f7340ac8640 1 -- 172.21.15.121:0/1943131842 shutdown_connections 2024-09-16T07:52:16.519 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:16.520+0000 7f7340ac8640 1 -- 172.21.15.121:0/1943131842 wait complete. 2024-09-16T07:52:16.535 INFO:tasks.workunit.client.0.smithi121.stderr:+ ceph osd pool set-quota 989b9542-ea3d-4c5c-8f96-23ff25b76fb1 max_objects 0 2024-09-16T07:52:16.647 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:16.633+0000 7f694b151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:16.648 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:16.650+0000 7f694b151640 1 Processor -- start 2024-09-16T07:52:16.648 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:16.650+0000 7f694b151640 1 -- start start 2024-09-16T07:52:16.650 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:16.651+0000 7f694b151640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f6944134150 0x7f6944134560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:52:16.650 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:16.652+0000 7f694b151640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f694409dda0 con 0x7f6944072cd0 2024-09-16T07:52:16.650 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:16.652+0000 7f694b151640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f69440a6280 con 0x7f6944134150 2024-09-16T07:52:16.651 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:16.652+0000 7f6948eed640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f6944134150 0x7f6944134560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:52:16.651 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:16.652+0000 7f6948eed640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f6944134150 0x7f6944134560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39404/0 (socket says 172.21.15.121:39404) 2024-09-16T07:52:16.651 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:16.652+0000 7f6948eed640 1 -- 172.21.15.121:0/3798806572 learned_addr learned my addr 172.21.15.121:0/3798806572 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:52:16.651 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:16.652+0000 7f6943fff640 1 --1- 172.21.15.121:0/3798806572 >> v1:172.21.15.121:6789/0 conn(0x7f6944072cd0 0x7f69440730e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:59190/0 (socket says 172.21.15.121:59190) 2024-09-16T07:52:16.652 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:16.652+0000 7f6948eed640 1 -- 172.21.15.121:0/3798806572 >> v1:172.21.15.121:6789/0 conn(0x7f6944072cd0 legacy=0x7f69440730e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:52:16.652 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:16.652+0000 7f6948eed640 1 -- 172.21.15.121:0/3798806572 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f694409ef80 con 0x7f6944134150 2024-09-16T07:52:16.652 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:16.652+0000 7f6948eed640 1 --2- 172.21.15.121:0/3798806572 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6944134150 0x7f6944134560 crc :-1 s=READY pgs=12984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6ea6adad474c3b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:52:16.652 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:16.652+0000 7f69437fe640 1 -- 172.21.15.121:0/3798806572 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f693c009e50 con 0x7f6944134150 2024-09-16T07:52:16.652 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:16.652+0000 7f69437fe640 1 -- 172.21.15.121:0/3798806572 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f693c00e230 con 0x7f6944134150 2024-09-16T07:52:16.652 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:16.652+0000 7f69437fe640 1 -- 172.21.15.121:0/3798806572 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f693c00e4d0 con 0x7f6944134150 2024-09-16T07:52:16.653 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:16.653+0000 7f694b151640 1 -- 172.21.15.121:0/3798806572 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6944134150 msgr2=0x7f6944134560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:52:16.653 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:16.653+0000 7f694b151640 1 --2- 172.21.15.121:0/3798806572 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6944134150 0x7f6944134560 crc :-1 s=READY pgs=12984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:16.653 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:16.653+0000 7f694b151640 1 -- 172.21.15.121:0/3798806572 shutdown_connections 2024-09-16T07:52:16.653 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:16.653+0000 7f694b151640 1 --2- 172.21.15.121:0/3798806572 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6944134150 0x7f6944134560 unknown :-1 s=CLOSED pgs=12984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:16.653 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:16.654+0000 7f694b151640 1 -- 172.21.15.121:0/3798806572 >> 172.21.15.121:0/3798806572 conn(0x7f69440a43d0 msgr2=0x7f69440a47e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:52:16.653 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:16.654+0000 7f694b151640 1 -- 172.21.15.121:0/3798806572 shutdown_connections 2024-09-16T07:52:16.653 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:16.654+0000 7f694b151640 1 -- 172.21.15.121:0/3798806572 wait complete. 2024-09-16T07:52:16.653 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:16.654+0000 7f694b151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:16.654 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:16.656+0000 7f694b151640 1 Processor -- start 2024-09-16T07:52:16.654 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:16.656+0000 7f694b151640 1 -- start start 2024-09-16T07:52:16.656 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:16.657+0000 7f694b151640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6944072cd0 0x7f6944121150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:52:16.656 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:16.657+0000 7f694b151640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6944124550 con 0x7f6944072cd0 2024-09-16T07:52:16.656 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:16.657+0000 7f6948eed640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6944072cd0 0x7f6944121150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:52:16.656 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:16.657+0000 7f6948eed640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6944072cd0 0x7f6944121150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39410/0 (socket says 172.21.15.121:39410) 2024-09-16T07:52:16.656 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:16.657+0000 7f6948eed640 1 -- 172.21.15.121:0/3180447218 learned_addr learned my addr 172.21.15.121:0/3180447218 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:52:16.656 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:16.657+0000 7f6948eed640 1 -- 172.21.15.121:0/3180447218 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6944122bd0 con 0x7f6944072cd0 2024-09-16T07:52:16.657 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:16.657+0000 7f6948eed640 1 --2- 172.21.15.121:0/3180447218 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6944072cd0 0x7f6944121150 crc :-1 s=READY pgs=12985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:52:16.657 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:16.658+0000 7f69417fa640 1 -- 172.21.15.121:0/3180447218 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f693c00ee10 con 0x7f6944072cd0 2024-09-16T07:52:16.657 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:16.658+0000 7f69417fa640 1 -- 172.21.15.121:0/3180447218 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f693c015420 con 0x7f6944072cd0 2024-09-16T07:52:16.657 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:16.658+0000 7f694b151640 1 -- 172.21.15.121:0/3180447218 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69441241b0 con 0x7f6944072cd0 2024-09-16T07:52:16.657 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:16.658+0000 7f69417fa640 1 -- 172.21.15.121:0/3180447218 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f693c0156c0 con 0x7f6944072cd0 2024-09-16T07:52:16.657 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:16.658+0000 7f694b151640 1 -- 172.21.15.121:0/3180447218 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6944123420 con 0x7f6944072cd0 2024-09-16T07:52:16.658 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:16.659+0000 7f69417fa640 1 -- 172.21.15.121:0/3180447218 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f693c015870 con 0x7f6944072cd0 2024-09-16T07:52:16.658 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:16.659+0000 7f69417fa640 1 --2- 172.21.15.121:0/3180447218 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f692403e930 0x7f6924040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:52:16.658 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:16.659+0000 7f694b151640 1 -- 172.21.15.121:0/3180447218 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f694409e4c0 con 0x7f6944072cd0 2024-09-16T07:52:16.658 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:16.659+0000 7f69417fa640 1 -- 172.21.15.121:0/3180447218 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(719..719 src has 620..719) ==== 4207+0+0 (crc 0 0 0) 0x7f693c051250 con 0x7f6944072cd0 2024-09-16T07:52:16.659 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:16.659+0000 7f69417fa640 1 -- 172.21.15.121:0/3180447218 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=720}) -- 0x7f6924045360 con 0x7f6944072cd0 2024-09-16T07:52:16.659 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:16.660+0000 7f6943fff640 1 --2- 172.21.15.121:0/3180447218 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f692403e930 0x7f6924040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:52:16.659 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:16.660+0000 7f6943fff640 1 --2- 172.21.15.121:0/3180447218 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f692403e930 0x7f6924040e40 crc :-1 s=READY pgs=3841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:52:16.667 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:16.668+0000 7f69417fa640 1 -- 172.21.15.121:0/3180447218 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f693c014c60 con 0x7f6944072cd0 2024-09-16T07:52:16.851 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:16.852+0000 7f694b151640 1 -- 172.21.15.121:0/3180447218 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "989b9542-ea3d-4c5c-8f96-23ff25b76fb1", "field": "max_objects", "val": "0"} v 0) -- 0x7f694409f3a0 con 0x7f6944072cd0 2024-09-16T07:52:17.525 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:17.526+0000 7f69417fa640 1 -- 172.21.15.121:0/3180447218 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "989b9542-ea3d-4c5c-8f96-23ff25b76fb1", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool 989b9542-ea3d-4c5c-8f96-23ff25b76fb1 v720) ==== 221+0+0 (crc 0 0 0) 0x7f693c010310 con 0x7f6944072cd0 2024-09-16T07:52:17.527 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:17.528+0000 7f69417fa640 1 -- 172.21.15.121:0/3180447218 <== mon.0 v2:172.21.15.121:3300/0 8 ==== osd_map(720..720 src has 620..720) ==== 628+0+0 (crc 0 0 0) 0x7f693c00f2a0 con 0x7f6944072cd0 2024-09-16T07:52:17.527 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:17.528+0000 7f69417fa640 1 -- 172.21.15.121:0/3180447218 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=721}) -- 0x7f69240463e0 con 0x7f6944072cd0 2024-09-16T07:52:17.644 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:17.645+0000 7f694b151640 1 -- 172.21.15.121:0/3180447218 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "989b9542-ea3d-4c5c-8f96-23ff25b76fb1", "field": "max_objects", "val": "0"} v 0) -- 0x7f694409dfb0 con 0x7f6944072cd0 2024-09-16T07:52:18.527 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:18.527+0000 7f69417fa640 1 -- 172.21.15.121:0/3180447218 <== mon.0 v2:172.21.15.121:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "989b9542-ea3d-4c5c-8f96-23ff25b76fb1", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool 989b9542-ea3d-4c5c-8f96-23ff25b76fb1 v721) ==== 221+0+0 (crc 0 0 0) 0x7f693c010a00 con 0x7f6944072cd0 2024-09-16T07:52:18.579 INFO:tasks.workunit.client.0.smithi121.stderr:set-quota max_objects = 0 for pool 989b9542-ea3d-4c5c-8f96-23ff25b76fb1 2024-09-16T07:52:18.580 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:18.529+0000 7f69417fa640 1 -- 172.21.15.121:0/3180447218 <== mon.0 v2:172.21.15.121:3300/0 10 ==== osd_map(721..721 src has 620..721) ==== 628+0+0 (crc 0 0 0) 0x7f693c011dd0 con 0x7f6944072cd0 2024-09-16T07:52:18.580 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:18.529+0000 7f694b151640 1 -- 172.21.15.121:0/3180447218 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f692403e930 msgr2=0x7f6924040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:52:18.581 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:18.530+0000 7f694b151640 1 --2- 172.21.15.121:0/3180447218 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f692403e930 0x7f6924040e40 crc :-1 s=READY pgs=3841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:18.581 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:18.530+0000 7f694b151640 1 -- 172.21.15.121:0/3180447218 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6944072cd0 msgr2=0x7f6944121150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:52:18.581 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:18.530+0000 7f694b151640 1 --2- 172.21.15.121:0/3180447218 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6944072cd0 0x7f6944121150 crc :-1 s=READY pgs=12985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:18.581 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:18.530+0000 7f694b151640 1 -- 172.21.15.121:0/3180447218 shutdown_connections 2024-09-16T07:52:18.581 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:18.530+0000 7f694b151640 1 --2- 172.21.15.121:0/3180447218 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f692403e930 0x7f6924040e40 unknown :-1 s=CLOSED pgs=3841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:18.581 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:18.530+0000 7f694b151640 1 --2- 172.21.15.121:0/3180447218 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6944072cd0 0x7f6944121150 unknown :-1 s=CLOSED pgs=12985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:18.581 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:18.530+0000 7f694b151640 1 -- 172.21.15.121:0/3180447218 >> 172.21.15.121:0/3180447218 conn(0x7f69440a43d0 msgr2=0x7f6944133630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:52:18.581 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:18.530+0000 7f694b151640 1 -- 172.21.15.121:0/3180447218 shutdown_connections 2024-09-16T07:52:18.581 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:18.530+0000 7f694b151640 1 -- 172.21.15.121:0/3180447218 wait complete. 2024-09-16T07:52:18.581 INFO:tasks.workunit.client.0.smithi121.stderr:+ sleep 30 2024-09-16T07:52:48.549 INFO:tasks.workunit.client.0.smithi121.stderr:+ ceph osd pool delete 989b9542-ea3d-4c5c-8f96-23ff25b76fb1 989b9542-ea3d-4c5c-8f96-23ff25b76fb1 --yes-i-really-really-mean-it 2024-09-16T07:52:48.665 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:48.651+0000 7fd6dd511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:48.666 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:48.668+0000 7fd6dd511640 1 Processor -- start 2024-09-16T07:52:48.667 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:48.668+0000 7fd6dd511640 1 -- start start 2024-09-16T07:52:48.668 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:48.669+0000 7fd6dd511640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd6d809dc80 0x7fd6d8072cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:52:48.668 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:48.669+0000 7fd6dd511640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6d809e510 con 0x7fd6d8073210 2024-09-16T07:52:48.668 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:48.669+0000 7fd6dd511640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fd6d8074a90 con 0x7fd6d809dc80 2024-09-16T07:52:48.668 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:48.669+0000 7fd6d6ffd640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd6d809dc80 0x7fd6d8072cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:52:48.668 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:48.669+0000 7fd6d67fc640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fd6d8073210 0x7fd6d8133c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:53328/0 (socket says 172.21.15.121:53328) 2024-09-16T07:52:48.668 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:48.669+0000 7fd6d67fc640 1 -- 172.21.15.121:0/3941357564 learned_addr learned my addr 172.21.15.121:0/3941357564 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-16T07:52:48.669 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:48.670+0000 7fd6d6ffd640 1 -- 172.21.15.121:0/3941357564 >> v1:172.21.15.121:6789/0 conn(0x7fd6d8073210 legacy=0x7fd6d8133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:52:48.669 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:48.670+0000 7fd6d5ffb640 1 -- 172.21.15.121:0/3941357564 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3359926417 0 0) 0x7fd6d809e510 con 0x7fd6d8073210 2024-09-16T07:52:48.670 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:48.670+0000 7fd6d6ffd640 1 -- 172.21.15.121:0/3941357564 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6d809e200 con 0x7fd6d809dc80 2024-09-16T07:52:48.670 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:48.670+0000 7fd6d6ffd640 1 --2- 172.21.15.121:0/3941357564 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd6d809dc80 0x7fd6d8072cd0 crc :-1 s=READY pgs=12987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8376f899619c799e server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:52:48.670 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:48.670+0000 7fd6d5ffb640 1 -- 172.21.15.121:0/3941357564 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd6c8009d90 con 0x7fd6d809dc80 2024-09-16T07:52:48.670 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:48.670+0000 7fd6d5ffb640 1 -- 172.21.15.121:0/3941357564 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fd6c800e230 con 0x7fd6d809dc80 2024-09-16T07:52:48.670 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:48.670+0000 7fd6d5ffb640 1 -- 172.21.15.121:0/3941357564 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd6c800e4d0 con 0x7fd6d809dc80 2024-09-16T07:52:48.671 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:48.671+0000 7fd6dd511640 1 -- 172.21.15.121:0/3941357564 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd6d809dc80 msgr2=0x7fd6d8072cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:52:48.671 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:48.671+0000 7fd6dd511640 1 --2- 172.21.15.121:0/3941357564 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd6d809dc80 0x7fd6d8072cd0 crc :-1 s=READY pgs=12987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:48.671 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:48.671+0000 7fd6dd511640 1 -- 172.21.15.121:0/3941357564 shutdown_connections 2024-09-16T07:52:48.671 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:48.671+0000 7fd6dd511640 1 --2- 172.21.15.121:0/3941357564 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd6d809dc80 0x7fd6d8072cd0 unknown :-1 s=CLOSED pgs=12987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:48.671 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:48.671+0000 7fd6dd511640 1 -- 172.21.15.121:0/3941357564 >> 172.21.15.121:0/3941357564 conn(0x7fd6d80a43d0 msgr2=0x7fd6d80a47e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:52:48.671 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:48.671+0000 7fd6dd511640 1 -- 172.21.15.121:0/3941357564 shutdown_connections 2024-09-16T07:52:48.671 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:48.671+0000 7fd6dd511640 1 -- 172.21.15.121:0/3941357564 wait complete. 2024-09-16T07:52:48.671 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:48.672+0000 7fd6dd511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:48.675 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:48.674+0000 7fd6dd511640 1 Processor -- start 2024-09-16T07:52:48.675 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:48.674+0000 7fd6dd511640 1 -- start start 2024-09-16T07:52:48.675 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:48.676+0000 7fd6dd511640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd6d8073210 0x7fd6d81cef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:52:48.675 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:48.676+0000 7fd6dd511640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d81203b0 con 0x7fd6d8073210 2024-09-16T07:52:48.675 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:48.676+0000 7fd6d6ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd6d8073210 0x7fd6d81cef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:52:48.675 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:48.676+0000 7fd6d6ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd6d8073210 0x7fd6d81cef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:45518/0 (socket says 172.21.15.121:45518) 2024-09-16T07:52:48.675 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:48.676+0000 7fd6d6ffd640 1 -- 172.21.15.121:0/551415168 learned_addr learned my addr 172.21.15.121:0/551415168 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:52:48.676 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:48.676+0000 7fd6d6ffd640 1 -- 172.21.15.121:0/551415168 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6d811f720 con 0x7fd6d8073210 2024-09-16T07:52:48.676 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:48.676+0000 7fd6d6ffd640 1 --2- 172.21.15.121:0/551415168 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd6d8073210 0x7fd6d81cef20 crc :-1 s=READY pgs=12988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:52:48.676 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:48.677+0000 7fd6bf7fe640 1 -- 172.21.15.121:0/551415168 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd6c8014540 con 0x7fd6d8073210 2024-09-16T07:52:48.676 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:48.677+0000 7fd6bf7fe640 1 -- 172.21.15.121:0/551415168 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fd6c80146a0 con 0x7fd6d8073210 2024-09-16T07:52:48.676 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:48.677+0000 7fd6dd511640 1 -- 172.21.15.121:0/551415168 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6d8121c10 con 0x7fd6d8073210 2024-09-16T07:52:48.676 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:48.677+0000 7fd6bf7fe640 1 -- 172.21.15.121:0/551415168 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd6c8014940 con 0x7fd6d8073210 2024-09-16T07:52:48.676 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:48.677+0000 7fd6dd511640 1 -- 172.21.15.121:0/551415168 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6d8120000 con 0x7fd6d8073210 2024-09-16T07:52:48.677 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:48.678+0000 7fd6bf7fe640 1 -- 172.21.15.121:0/551415168 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fd6c8014b40 con 0x7fd6d8073210 2024-09-16T07:52:48.677 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:48.678+0000 7fd6bf7fe640 1 --2- 172.21.15.121:0/551415168 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fd6c403e8e0 0x7fd6c4040df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:52:48.677 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:48.678+0000 7fd6dd511640 1 -- 172.21.15.121:0/551415168 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6d809ef50 con 0x7fd6d8073210 2024-09-16T07:52:48.677 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:48.678+0000 7fd6bf7fe640 1 -- 172.21.15.121:0/551415168 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(721..721 src has 620..721) ==== 4207+0+0 (crc 0 0 0) 0x7fd6c8019040 con 0x7fd6d8073210 2024-09-16T07:52:48.678 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:48.679+0000 7fd6bf7fe640 1 -- 172.21.15.121:0/551415168 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=722}) -- 0x7fd6c4045310 con 0x7fd6d8073210 2024-09-16T07:52:48.678 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:48.679+0000 7fd6d67fc640 1 --2- 172.21.15.121:0/551415168 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fd6c403e8e0 0x7fd6c4040df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:52:48.678 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:48.679+0000 7fd6d67fc640 1 --2- 172.21.15.121:0/551415168 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fd6c403e8e0 0x7fd6c4040df0 crc :-1 s=READY pgs=3842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:52:48.686 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:48.687+0000 7fd6bf7fe640 1 -- 172.21.15.121:0/551415168 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fd6c8018790 con 0x7fd6d8073210 2024-09-16T07:52:48.869 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:48.871+0000 7fd6dd511640 1 -- 172.21.15.121:0/551415168 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "989b9542-ea3d-4c5c-8f96-23ff25b76fb1", "pool2": "989b9542-ea3d-4c5c-8f96-23ff25b76fb1", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd6d8073a40 con 0x7fd6d8073210 2024-09-16T07:52:49.573 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:49.572+0000 7fd6bf7fe640 1 -- 172.21.15.121:0/551415168 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "989b9542-ea3d-4c5c-8f96-23ff25b76fb1", "pool2": "989b9542-ea3d-4c5c-8f96-23ff25b76fb1", "yes_i_really_really_mean_it": true}]=0 pool '989b9542-ea3d-4c5c-8f96-23ff25b76fb1' removed v722) ==== 248+0+0 (crc 0 0 0) 0x7fd6c8008f20 con 0x7fd6d8073210 2024-09-16T07:52:49.573 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:49.572+0000 7fd6bf7fe640 1 -- 172.21.15.121:0/551415168 <== mon.0 v2:172.21.15.121:3300/0 8 ==== osd_map(722..722 src has 620..722) ==== 296+0+0 (crc 0 0 0) 0x7fd6c8018530 con 0x7fd6d8073210 2024-09-16T07:52:49.574 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:49.572+0000 7fd6bf7fe640 1 -- 172.21.15.121:0/551415168 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=723}) -- 0x7fd6c4045e00 con 0x7fd6d8073210 2024-09-16T07:52:49.714 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:49.715+0000 7fd6dd511640 1 -- 172.21.15.121:0/551415168 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "989b9542-ea3d-4c5c-8f96-23ff25b76fb1", "pool2": "989b9542-ea3d-4c5c-8f96-23ff25b76fb1", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd6d80008d0 con 0x7fd6d8073210 2024-09-16T07:52:49.714 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:49.716+0000 7fd6bf7fe640 1 -- 172.21.15.121:0/551415168 <== mon.0 v2:172.21.15.121:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "989b9542-ea3d-4c5c-8f96-23ff25b76fb1", "pool2": "989b9542-ea3d-4c5c-8f96-23ff25b76fb1", "yes_i_really_really_mean_it": true}]=0 pool '989b9542-ea3d-4c5c-8f96-23ff25b76fb1' does not exist v722) ==== 255+0+0 (crc 0 0 0) 0x7fd6c800f2a0 con 0x7fd6d8073210 2024-09-16T07:52:49.715 INFO:tasks.workunit.client.0.smithi121.stderr:pool '989b9542-ea3d-4c5c-8f96-23ff25b76fb1' does not exist 2024-09-16T07:52:49.718 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:49.718+0000 7fd6dd511640 1 -- 172.21.15.121:0/551415168 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fd6c403e8e0 msgr2=0x7fd6c4040df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:52:49.718 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:49.718+0000 7fd6dd511640 1 --2- 172.21.15.121:0/551415168 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fd6c403e8e0 0x7fd6c4040df0 crc :-1 s=READY pgs=3842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:49.718 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:49.718+0000 7fd6dd511640 1 -- 172.21.15.121:0/551415168 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd6d8073210 msgr2=0x7fd6d81cef20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:52:49.718 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:49.718+0000 7fd6dd511640 1 --2- 172.21.15.121:0/551415168 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd6d8073210 0x7fd6d81cef20 crc :-1 s=READY pgs=12988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:49.718 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:49.719+0000 7fd6dd511640 1 -- 172.21.15.121:0/551415168 shutdown_connections 2024-09-16T07:52:49.718 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:49.719+0000 7fd6dd511640 1 --2- 172.21.15.121:0/551415168 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fd6c403e8e0 0x7fd6c4040df0 unknown :-1 s=CLOSED pgs=3842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:49.719 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:49.719+0000 7fd6dd511640 1 --2- 172.21.15.121:0/551415168 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd6d8073210 0x7fd6d81cef20 unknown :-1 s=CLOSED pgs=12988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:49.719 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:49.719+0000 7fd6dd511640 1 -- 172.21.15.121:0/551415168 >> 172.21.15.121:0/551415168 conn(0x7fd6d80a43d0 msgr2=0x7fd6d80a0ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:52:49.719 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:49.719+0000 7fd6dd511640 1 -- 172.21.15.121:0/551415168 shutdown_connections 2024-09-16T07:52:49.719 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:49.719+0000 7fd6dd511640 1 -- 172.21.15.121:0/551415168 wait complete. 2024-09-16T07:52:49.730 INFO:tasks.workunit.client.0.smithi121.stderr:+ ceph osd pool delete d3276ed3-e996-4bbc-b28e-567739f7faa8 d3276ed3-e996-4bbc-b28e-567739f7faa8 --yes-i-really-really-mean-it 2024-09-16T07:52:49.823 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:49.816+0000 7fec23f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:49.824 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:49.825+0000 7fec23f91640 1 Processor -- start 2024-09-16T07:52:49.824 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:49.826+0000 7fec23f91640 1 -- start start 2024-09-16T07:52:49.826 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:49.827+0000 7fec23f91640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fec1c0a0db0 0x7fec1c13b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:52:49.826 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:49.827+0000 7fec23f91640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec1c06acc0 con 0x7fec1c0a0290 2024-09-16T07:52:49.826 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:49.827+0000 7fec23f91640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fec1c06ed30 con 0x7fec1c0a0db0 2024-09-16T07:52:49.826 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:49.827+0000 7fec2152c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fec1c0a0db0 0x7fec1c13b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:52:49.826 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:49.827+0000 7fec2152c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fec1c0a0db0 0x7fec1c13b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:45532/0 (socket says 172.21.15.121:45532) 2024-09-16T07:52:49.827 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:49.827+0000 7fec21d2d640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fec1c0a0290 0x7fec1c0a06a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:53330/0 (socket says 172.21.15.121:53330) 2024-09-16T07:52:49.827 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:49.827+0000 7fec2152c640 1 -- 172.21.15.121:0/2441131706 learned_addr learned my addr 172.21.15.121:0/2441131706 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:52:49.827 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:49.827+0000 7fec2152c640 1 -- 172.21.15.121:0/2441131706 >> v1:172.21.15.121:6789/0 conn(0x7fec1c0a0290 legacy=0x7fec1c0a06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:52:49.827 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:49.827+0000 7fec2152c640 1 -- 172.21.15.121:0/2441131706 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec1c0a1ae0 con 0x7fec1c0a0db0 2024-09-16T07:52:49.827 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:49.827+0000 7fec20d2b640 1 -- 172.21.15.121:0/2441131706 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3789744511 0 0) 0x7fec1c06acc0 con 0x7fec1c0a0290 2024-09-16T07:52:49.827 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:49.827+0000 7fec2152c640 1 --2- 172.21.15.121:0/2441131706 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec1c0a0db0 0x7fec1c13b3f0 crc :-1 s=READY pgs=12990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d255db29bbfb4062 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:52:49.827 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:49.827+0000 7fec20d2b640 1 -- 172.21.15.121:0/2441131706 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fec0c009e50 con 0x7fec1c0a0db0 2024-09-16T07:52:49.827 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:49.828+0000 7fec20d2b640 1 -- 172.21.15.121:0/2441131706 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fec0c00e230 con 0x7fec1c0a0db0 2024-09-16T07:52:49.827 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:49.828+0000 7fec20d2b640 1 -- 172.21.15.121:0/2441131706 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fec0c00e4d0 con 0x7fec1c0a0db0 2024-09-16T07:52:49.828 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:49.828+0000 7fec23f91640 1 -- 172.21.15.121:0/2441131706 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec1c0a0db0 msgr2=0x7fec1c13b3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:52:49.828 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:49.828+0000 7fec23f91640 1 --2- 172.21.15.121:0/2441131706 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec1c0a0db0 0x7fec1c13b3f0 crc :-1 s=READY pgs=12990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:49.828 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:49.828+0000 7fec23f91640 1 -- 172.21.15.121:0/2441131706 shutdown_connections 2024-09-16T07:52:49.828 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:49.828+0000 7fec23f91640 1 --2- 172.21.15.121:0/2441131706 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec1c0a0db0 0x7fec1c13b3f0 unknown :-1 s=CLOSED pgs=12990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:49.828 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:49.828+0000 7fec23f91640 1 -- 172.21.15.121:0/2441131706 >> 172.21.15.121:0/2441131706 conn(0x7fec1c09d9e0 msgr2=0x7fec1c09ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:52:49.828 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:49.828+0000 7fec23f91640 1 -- 172.21.15.121:0/2441131706 shutdown_connections 2024-09-16T07:52:49.828 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:49.828+0000 7fec23f91640 1 -- 172.21.15.121:0/2441131706 wait complete. 2024-09-16T07:52:49.829 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:49.829+0000 7fec23f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:49.829 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:49.830+0000 7fec23f91640 1 Processor -- start 2024-09-16T07:52:49.829 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:49.830+0000 7fec23f91640 1 -- start start 2024-09-16T07:52:49.830 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:49.831+0000 7fec23f91640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec1c0a0290 0x7fec1c122c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:52:49.830 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:49.831+0000 7fec23f91640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fec1c1221b0 con 0x7fec1c0a0290 2024-09-16T07:52:49.831 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:49.831+0000 7fec21d2d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec1c0a0290 0x7fec1c122c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:52:49.831 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:49.831+0000 7fec21d2d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec1c0a0290 0x7fec1c122c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:45546/0 (socket says 172.21.15.121:45546) 2024-09-16T07:52:49.831 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:49.831+0000 7fec21d2d640 1 -- 172.21.15.121:0/403294315 learned_addr learned my addr 172.21.15.121:0/403294315 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:52:49.831 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:49.831+0000 7fec21d2d640 1 -- 172.21.15.121:0/403294315 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec1c122740 con 0x7fec1c0a0290 2024-09-16T07:52:49.831 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:49.831+0000 7fec21d2d640 1 --2- 172.21.15.121:0/403294315 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec1c0a0290 0x7fec1c122c90 crc :-1 s=READY pgs=12991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:52:49.831 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:49.832+0000 7fec127fc640 1 -- 172.21.15.121:0/403294315 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fec18004b80 con 0x7fec1c0a0290 2024-09-16T07:52:49.831 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:49.832+0000 7fec127fc640 1 -- 172.21.15.121:0/403294315 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fec18004ce0 con 0x7fec1c0a0290 2024-09-16T07:52:49.831 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:49.832+0000 7fec23f91640 1 -- 172.21.15.121:0/403294315 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec1c1223a0 con 0x7fec1c0a0290 2024-09-16T07:52:49.831 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:49.832+0000 7fec127fc640 1 -- 172.21.15.121:0/403294315 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fec18007120 con 0x7fec1c0a0290 2024-09-16T07:52:49.831 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:49.832+0000 7fec23f91640 1 -- 172.21.15.121:0/403294315 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec1c125c80 con 0x7fec1c0a0290 2024-09-16T07:52:49.832 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:49.833+0000 7fec127fc640 1 -- 172.21.15.121:0/403294315 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fec180072d0 con 0x7fec1c0a0290 2024-09-16T07:52:49.832 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:49.833+0000 7fec23f91640 1 -- 172.21.15.121:0/403294315 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec1c122590 con 0x7fec1c0a0290 2024-09-16T07:52:49.832 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:49.833+0000 7fec127fc640 1 --2- 172.21.15.121:0/403294315 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fec0003e930 0x7fec00040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:52:49.832 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:49.833+0000 7fec127fc640 1 -- 172.21.15.121:0/403294315 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(722..722 src has 620..722) ==== 3819+0+0 (crc 0 0 0) 0x7fec1804fc60 con 0x7fec1c0a0290 2024-09-16T07:52:49.832 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:49.833+0000 7fec127fc640 1 -- 172.21.15.121:0/403294315 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=723}) -- 0x7fec00044bc0 con 0x7fec1c0a0290 2024-09-16T07:52:49.832 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:49.833+0000 7fec2152c640 1 --2- 172.21.15.121:0/403294315 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fec0003e930 0x7fec00040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:52:49.833 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:49.834+0000 7fec2152c640 1 --2- 172.21.15.121:0/403294315 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fec0003e930 0x7fec00040e40 crc :-1 s=READY pgs=3843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:52:49.837 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:49.838+0000 7fec127fc640 1 -- 172.21.15.121:0/403294315 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fec1800f420 con 0x7fec1c0a0290 2024-09-16T07:52:50.015 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:50.016+0000 7fec23f91640 1 -- 172.21.15.121:0/403294315 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "d3276ed3-e996-4bbc-b28e-567739f7faa8", "pool2": "d3276ed3-e996-4bbc-b28e-567739f7faa8", "yes_i_really_really_mean_it": true} v 0) -- 0x7fec1c06fb30 con 0x7fec1c0a0290 2024-09-16T07:52:50.572 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:50.573+0000 7fec127fc640 1 -- 172.21.15.121:0/403294315 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "d3276ed3-e996-4bbc-b28e-567739f7faa8", "pool2": "d3276ed3-e996-4bbc-b28e-567739f7faa8", "yes_i_really_really_mean_it": true}]=0 pool 'd3276ed3-e996-4bbc-b28e-567739f7faa8' removed v723) ==== 248+0+0 (crc 0 0 0) 0x7fec18006740 con 0x7fec1c0a0290 2024-09-16T07:52:50.572 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:50.573+0000 7fec127fc640 1 -- 172.21.15.121:0/403294315 <== mon.0 v2:172.21.15.121:3300/0 8 ==== osd_map(723..723 src has 620..723) ==== 296+0+0 (crc 0 0 0) 0x7fec1800cdc0 con 0x7fec1c0a0290 2024-09-16T07:52:50.572 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:50.573+0000 7fec127fc640 1 -- 172.21.15.121:0/403294315 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=724}) -- 0x7fec00045910 con 0x7fec1c0a0290 2024-09-16T07:52:50.729 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:50.730+0000 7fec23f91640 1 -- 172.21.15.121:0/403294315 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "d3276ed3-e996-4bbc-b28e-567739f7faa8", "pool2": "d3276ed3-e996-4bbc-b28e-567739f7faa8", "yes_i_really_really_mean_it": true} v 0) -- 0x7fec1c0008d0 con 0x7fec1c0a0290 2024-09-16T07:52:50.730 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:50.731+0000 7fec127fc640 1 -- 172.21.15.121:0/403294315 <== mon.0 v2:172.21.15.121:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "d3276ed3-e996-4bbc-b28e-567739f7faa8", "pool2": "d3276ed3-e996-4bbc-b28e-567739f7faa8", "yes_i_really_really_mean_it": true}]=0 pool 'd3276ed3-e996-4bbc-b28e-567739f7faa8' does not exist v723) ==== 255+0+0 (crc 0 0 0) 0x7fec1800a0c0 con 0x7fec1c0a0290 2024-09-16T07:52:50.730 INFO:tasks.workunit.client.0.smithi121.stderr:pool 'd3276ed3-e996-4bbc-b28e-567739f7faa8' does not exist 2024-09-16T07:52:50.732 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:50.733+0000 7fec23f91640 1 -- 172.21.15.121:0/403294315 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fec0003e930 msgr2=0x7fec00040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:52:50.732 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:50.733+0000 7fec23f91640 1 --2- 172.21.15.121:0/403294315 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fec0003e930 0x7fec00040e40 crc :-1 s=READY pgs=3843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:50.733 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:50.733+0000 7fec23f91640 1 -- 172.21.15.121:0/403294315 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec1c0a0290 msgr2=0x7fec1c122c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:52:50.733 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:50.733+0000 7fec23f91640 1 --2- 172.21.15.121:0/403294315 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec1c0a0290 0x7fec1c122c90 crc :-1 s=READY pgs=12991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:50.733 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:50.733+0000 7fec23f91640 1 -- 172.21.15.121:0/403294315 shutdown_connections 2024-09-16T07:52:50.733 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:50.733+0000 7fec23f91640 1 --2- 172.21.15.121:0/403294315 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fec0003e930 0x7fec00040e40 unknown :-1 s=CLOSED pgs=3843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:50.733 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:50.733+0000 7fec23f91640 1 --2- 172.21.15.121:0/403294315 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec1c0a0290 0x7fec1c122c90 unknown :-1 s=CLOSED pgs=12991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:50.733 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:50.733+0000 7fec23f91640 1 -- 172.21.15.121:0/403294315 >> 172.21.15.121:0/403294315 conn(0x7fec1c09d9e0 msgr2=0x7fec1c135c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:52:50.733 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:50.733+0000 7fec23f91640 1 -- 172.21.15.121:0/403294315 shutdown_connections 2024-09-16T07:52:50.733 INFO:tasks.workunit.client.0.smithi121.stderr:2024-09-16T07:52:50.733+0000 7fec23f91640 1 -- 172.21.15.121:0/403294315 wait complete. 2024-09-16T07:52:50.741 INFO:tasks.workunit.client.0.smithi121.stderr:+ echo OK 2024-09-16T07:52:50.743 INFO:tasks.workunit.client.0.smithi121.stdout:OK 2024-09-16T07:52:50.743 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-16T07:52:50.743 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-16T07:52:50.808 INFO:tasks.workunit:Stopping ['rados/test.sh --crimson', 'rados/test_pool_quota.sh'] on client.0... 2024-09-16T07:52:50.808 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-16T07:52:51.125 DEBUG:teuthology.parallel:result is None 2024-09-16T07:52:51.126 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-16T07:52:51.151 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-16T07:52:51.151 DEBUG:teuthology.orchestra.run.smithi121:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-16T07:52:51.222 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-16T07:52:51.222 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-16T07:52:51.232 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-16T07:52:51.232 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:52:51.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.370+0000 7f4a12f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:51.374 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.375+0000 7f4a12f91640 1 Processor -- start 2024-09-16T07:52:51.374 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.375+0000 7f4a12f91640 1 -- start start 2024-09-16T07:52:51.377 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.377+0000 7f4a12f91640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f4a0c06f3a0 0x7f4a0c06f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:52:51.377 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.377+0000 7f4a12f91640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a0c06ed60 con 0x7f4a0c06fcf0 2024-09-16T07:52:51.377 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.377+0000 7f4a12f91640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f4a0c0a3ed0 con 0x7f4a0c06f3a0 2024-09-16T07:52:51.377 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.377+0000 7f4a10d2d640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f4a0c06f3a0 0x7f4a0c06f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:52:51.377 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.377+0000 7f4a0bfff640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f4a0c06fcf0 0x7f4a0c132de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:53340/0 (socket says 172.21.15.121:53340) 2024-09-16T07:52:51.377 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.377+0000 7f4a10d2d640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f4a0c06f3a0 0x7f4a0c06f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:45550/0 (socket says 172.21.15.121:45550) 2024-09-16T07:52:51.378 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.377+0000 7f4a0bfff640 1 -- 172.21.15.121:0/2173705425 learned_addr learned my addr 172.21.15.121:0/2173705425 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-16T07:52:51.378 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.377+0000 7f4a0b7fe640 1 -- 172.21.15.121:0/2173705425 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1318239075 0 0) 0x7f4a0c06ed60 con 0x7f4a0c06fcf0 2024-09-16T07:52:51.378 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.377+0000 7f4a0b7fe640 1 -- 172.21.15.121:0/2173705425 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f49f4003580 con 0x7f4a0c06fcf0 2024-09-16T07:52:51.378 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.377+0000 7f4a10d2d640 1 -- 172.21.15.121:0/2173705425 >> v1:172.21.15.121:6789/0 conn(0x7f4a0c06fcf0 legacy=0x7f4a0c132de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:52:51.378 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.377+0000 7f4a10d2d640 1 -- 172.21.15.121:0/2173705425 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a0c0a4170 con 0x7f4a0c06f3a0 2024-09-16T07:52:51.378 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.377+0000 7f4a10d2d640 1 --2- 172.21.15.121:0/2173705425 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4a0c06f3a0 0x7f4a0c06f7b0 crc :-1 s=READY pgs=12993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67da8e5b5c076a13 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:52:51.378 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.377+0000 7f4a0b7fe640 1 -- 172.21.15.121:0/2173705425 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f49fc009d80 con 0x7f4a0c06f3a0 2024-09-16T07:52:51.378 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.377+0000 7f4a0b7fe640 1 -- 172.21.15.121:0/2173705425 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f49fc00e230 con 0x7f4a0c06f3a0 2024-09-16T07:52:51.378 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.377+0000 7f4a0b7fe640 1 -- 172.21.15.121:0/2173705425 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f49fc00e4d0 con 0x7f4a0c06f3a0 2024-09-16T07:52:51.378 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.378+0000 7f4a12f91640 1 -- 172.21.15.121:0/2173705425 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4a0c06f3a0 msgr2=0x7f4a0c06f7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:52:51.378 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.378+0000 7f4a12f91640 1 --2- 172.21.15.121:0/2173705425 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4a0c06f3a0 0x7f4a0c06f7b0 crc :-1 s=READY pgs=12993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:51.378 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.378+0000 7f4a12f91640 1 -- 172.21.15.121:0/2173705425 shutdown_connections 2024-09-16T07:52:51.378 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.378+0000 7f4a12f91640 1 --2- 172.21.15.121:0/2173705425 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4a0c06f3a0 0x7f4a0c06f7b0 unknown :-1 s=CLOSED pgs=12993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:51.378 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.378+0000 7f4a12f91640 1 -- 172.21.15.121:0/2173705425 >> 172.21.15.121:0/2173705425 conn(0x7f4a0c0a33b0 msgr2=0x7f4a0c0a37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:52:51.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.378+0000 7f4a12f91640 1 -- 172.21.15.121:0/2173705425 shutdown_connections 2024-09-16T07:52:51.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.378+0000 7f4a12f91640 1 -- 172.21.15.121:0/2173705425 wait complete. 2024-09-16T07:52:51.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.379+0000 7f4a12f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:51.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.380+0000 7f4a12f91640 1 Processor -- start 2024-09-16T07:52:51.380 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.380+0000 7f4a12f91640 1 -- start start 2024-09-16T07:52:51.381 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.381+0000 7f4a12f91640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4a0c06f3a0 0x7f4a0c124db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:52:51.381 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.381+0000 7f4a12f91640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4a0c133e30 con 0x7f4a0c06f3a0 2024-09-16T07:52:51.381 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.381+0000 7f4a10d2d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4a0c06f3a0 0x7f4a0c124db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:52:51.381 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.381+0000 7f4a10d2d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4a0c06f3a0 0x7f4a0c124db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:45560/0 (socket says 172.21.15.121:45560) 2024-09-16T07:52:51.381 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.381+0000 7f4a10d2d640 1 -- 172.21.15.121:0/1605030718 learned_addr learned my addr 172.21.15.121:0/1605030718 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:52:51.381 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.381+0000 7f4a10d2d640 1 -- 172.21.15.121:0/1605030718 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a0c0a0dc0 con 0x7f4a0c06f3a0 2024-09-16T07:52:51.381 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.382+0000 7f4a10d2d640 1 --2- 172.21.15.121:0/1605030718 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4a0c06f3a0 0x7f4a0c124db0 crc :-1 s=READY pgs=12994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:52:51.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.382+0000 7f4a097fa640 1 -- 172.21.15.121:0/1605030718 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f49fc014410 con 0x7f4a0c06f3a0 2024-09-16T07:52:51.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.382+0000 7f4a097fa640 1 -- 172.21.15.121:0/1605030718 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f49fc014570 con 0x7f4a0c06f3a0 2024-09-16T07:52:51.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.382+0000 7f4a12f91640 1 -- 172.21.15.121:0/1605030718 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a0c0a04d0 con 0x7f4a0c06f3a0 2024-09-16T07:52:51.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.382+0000 7f4a097fa640 1 -- 172.21.15.121:0/1605030718 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f49fc014810 con 0x7f4a0c06f3a0 2024-09-16T07:52:51.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.382+0000 7f4a12f91640 1 -- 172.21.15.121:0/1605030718 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a0c124490 con 0x7f4a0c06f3a0 2024-09-16T07:52:51.383 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.383+0000 7f4a097fa640 1 -- 172.21.15.121:0/1605030718 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f49fc0149c0 con 0x7f4a0c06f3a0 2024-09-16T07:52:51.383 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.383+0000 7f4a097fa640 1 --2- 172.21.15.121:0/1605030718 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f49f803e930 0x7f49f8040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:52:51.383 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.383+0000 7f4a097fa640 1 -- 172.21.15.121:0/1605030718 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(723..723 src has 620..723) ==== 3431+0+0 (crc 0 0 0) 0x7f49fc019040 con 0x7f4a0c06f3a0 2024-09-16T07:52:51.383 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.383+0000 7f4a12f91640 1 -- 172.21.15.121:0/1605030718 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a0c06f7b0 con 0x7f4a0c06f3a0 2024-09-16T07:52:51.383 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.383+0000 7f4a0bfff640 1 --2- 172.21.15.121:0/1605030718 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f49f803e930 0x7f49f8040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:52:51.383 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.384+0000 7f4a0bfff640 1 --2- 172.21.15.121:0/1605030718 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f49f803e930 0x7f49f8040e40 crc :-1 s=READY pgs=3844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:52:51.387 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.388+0000 7f4a097fa640 1 -- 172.21.15.121:0/1605030718 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f49fc013cb0 con 0x7f4a0c06f3a0 2024-09-16T07:52:51.559 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.560+0000 7f4a12f91640 1 -- 172.21.15.121:0/1605030718 --> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4a0c0a1c60 con 0x7f49f803e930 2024-09-16T07:52:51.562 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.564+0000 7f4a097fa640 1 -- 172.21.15.121:0/1605030718 <== mgr.4102 v2:172.21.15.172:6800/643901738 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+109227 (crc 0 0 0) 0x7f4a00005910 con 0x7f49f803e930 2024-09-16T07:52:51.563 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:52:51.564 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-09-16T07:52:51.566 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.566+0000 7f4a12f91640 1 -- 172.21.15.121:0/1605030718 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f49f803e930 msgr2=0x7f49f8040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:52:51.566 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.566+0000 7f4a12f91640 1 --2- 172.21.15.121:0/1605030718 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f49f803e930 0x7f49f8040e40 crc :-1 s=READY pgs=3844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:51.567 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.566+0000 7f4a12f91640 1 -- 172.21.15.121:0/1605030718 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4a0c06f3a0 msgr2=0x7f4a0c124db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:52:51.567 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.566+0000 7f4a12f91640 1 --2- 172.21.15.121:0/1605030718 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4a0c06f3a0 0x7f4a0c124db0 crc :-1 s=READY pgs=12994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:51.567 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.566+0000 7f4a12f91640 1 -- 172.21.15.121:0/1605030718 shutdown_connections 2024-09-16T07:52:51.567 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.566+0000 7f4a12f91640 1 --2- 172.21.15.121:0/1605030718 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f49f803e930 0x7f49f8040e40 unknown :-1 s=CLOSED pgs=3844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:51.567 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.566+0000 7f4a12f91640 1 --2- 172.21.15.121:0/1605030718 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4a0c06f3a0 0x7f4a0c124db0 unknown :-1 s=CLOSED pgs=12994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:51.567 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.566+0000 7f4a12f91640 1 -- 172.21.15.121:0/1605030718 >> 172.21.15.121:0/1605030718 conn(0x7f4a0c0a33b0 msgr2=0x7f4a0c09e780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:52:51.567 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.566+0000 7f4a12f91640 1 -- 172.21.15.121:0/1605030718 shutdown_connections 2024-09-16T07:52:51.567 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.566+0000 7f4a12f91640 1 -- 172.21.15.121:0/1605030718 wait complete. 2024-09-16T07:52:51.576 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":1286,"stamp":"2024-09-16T07:52:51.129015+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590392,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":52,"num_write":88,"num_write_kb":1115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":62,"ondisk_log_size":62,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":255936,"kb_used_data":7040,"kb_used_omap":0,"kb_used_meta":248832,"kb_avail":377231424,"statfs":{"total":386547056640,"available":386284978176,"internally_reserved":0,"allocated":7208960,"data_stored":3478166,"data_compressed":189624,"data_compressed_allocated":262144,"data_compressed_original":1417216,"omap_allocated":0,"internal_metadata":254803968},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-321875,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-25,"num_write_kb":-325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002060"},"pg_stats":[{"pgid":"75.1f","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.604966+0000","last_change":"2024-09-16T07:38:56.550066+0000","last_active":"2024-09-16T07:52:49.604966+0000","last_peered":"2024-09-16T07:52:49.604966+0000","last_clean":"2024-09-16T07:52:49.604966+0000","last_became_active":"2024-09-16T07:38:56.541997+0000","last_became_peered":"2024-09-16T07:38:56.541997+0000","last_unstale":"2024-09-16T07:52:49.604966+0000","last_undegraded":"2024-09-16T07:52:49.604966+0000","last_fullsized":"2024-09-16T07:52:49.604966+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1e","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.627314+0000","last_change":"2024-09-16T07:38:56.566272+0000","last_active":"2024-09-16T07:52:49.627314+0000","last_peered":"2024-09-16T07:52:49.627314+0000","last_clean":"2024-09-16T07:52:49.627314+0000","last_became_active":"2024-09-16T07:38:56.548814+0000","last_became_peered":"2024-09-16T07:38:56.548814+0000","last_unstale":"2024-09-16T07:52:49.627314+0000","last_undegraded":"2024-09-16T07:52:49.627314+0000","last_fullsized":"2024-09-16T07:52:49.627314+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1d","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.614967+0000","last_change":"2024-09-16T07:38:56.550793+0000","last_active":"2024-09-16T07:52:49.614967+0000","last_peered":"2024-09-16T07:52:49.614967+0000","last_clean":"2024-09-16T07:52:49.614967+0000","last_became_active":"2024-09-16T07:38:56.543879+0000","last_became_peered":"2024-09-16T07:38:56.543879+0000","last_unstale":"2024-09-16T07:52:49.614967+0000","last_undegraded":"2024-09-16T07:52:49.614967+0000","last_fullsized":"2024-09-16T07:52:49.614967+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.1c","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.600522+0000","last_change":"2024-09-16T07:38:56.599574+0000","last_active":"2024-09-16T07:52:49.600522+0000","last_peered":"2024-09-16T07:52:49.600522+0000","last_clean":"2024-09-16T07:52:49.600522+0000","last_became_active":"2024-09-16T07:38:56.593078+0000","last_became_peered":"2024-09-16T07:38:56.593078+0000","last_unstale":"2024-09-16T07:52:49.600522+0000","last_undegraded":"2024-09-16T07:52:49.600522+0000","last_fullsized":"2024-09-16T07:52:49.600522+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1b","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.609809+0000","last_change":"2024-09-16T07:38:56.553575+0000","last_active":"2024-09-16T07:52:49.609809+0000","last_peered":"2024-09-16T07:52:49.609809+0000","last_clean":"2024-09-16T07:52:49.609809+0000","last_became_active":"2024-09-16T07:38:56.546684+0000","last_became_peered":"2024-09-16T07:38:56.546684+0000","last_unstale":"2024-09-16T07:52:49.609809+0000","last_undegraded":"2024-09-16T07:52:49.609809+0000","last_fullsized":"2024-09-16T07:52:49.609809+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1a","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.609607+0000","last_change":"2024-09-16T07:38:56.571451+0000","last_active":"2024-09-16T07:52:49.609607+0000","last_peered":"2024-09-16T07:52:49.609607+0000","last_clean":"2024-09-16T07:52:49.609607+0000","last_became_active":"2024-09-16T07:38:56.532518+0000","last_became_peered":"2024-09-16T07:38:56.532518+0000","last_unstale":"2024-09-16T07:52:49.609607+0000","last_undegraded":"2024-09-16T07:52:49.609607+0000","last_fullsized":"2024-09-16T07:52:49.609607+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.19","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.648724+0000","last_change":"2024-09-16T07:38:56.613450+0000","last_active":"2024-09-16T07:52:49.648724+0000","last_peered":"2024-09-16T07:52:49.648724+0000","last_clean":"2024-09-16T07:52:49.648724+0000","last_became_active":"2024-09-16T07:38:56.606292+0000","last_became_peered":"2024-09-16T07:38:56.606292+0000","last_unstale":"2024-09-16T07:52:49.648724+0000","last_undegraded":"2024-09-16T07:52:49.648724+0000","last_fullsized":"2024-09-16T07:52:49.648724+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.18","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.609181+0000","last_change":"2024-09-16T07:38:56.638294+0000","last_active":"2024-09-16T07:52:49.609181+0000","last_peered":"2024-09-16T07:52:49.609181+0000","last_clean":"2024-09-16T07:52:49.609181+0000","last_became_active":"2024-09-16T07:38:56.630903+0000","last_became_peered":"2024-09-16T07:38:56.630903+0000","last_unstale":"2024-09-16T07:52:49.609181+0000","last_undegraded":"2024-09-16T07:52:49.609181+0000","last_fullsized":"2024-09-16T07:52:49.609181+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.17","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.588474+0000","last_change":"2024-09-16T07:38:56.531333+0000","last_active":"2024-09-16T07:52:49.588474+0000","last_peered":"2024-09-16T07:52:49.588474+0000","last_clean":"2024-09-16T07:52:49.588474+0000","last_became_active":"2024-09-16T07:38:56.515359+0000","last_became_peered":"2024-09-16T07:38:56.515359+0000","last_unstale":"2024-09-16T07:52:49.588474+0000","last_undegraded":"2024-09-16T07:52:49.588474+0000","last_fullsized":"2024-09-16T07:52:49.588474+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.16","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.596551+0000","last_change":"2024-09-16T07:38:56.527850+0000","last_active":"2024-09-16T07:52:49.596551+0000","last_peered":"2024-09-16T07:52:49.596551+0000","last_clean":"2024-09-16T07:52:49.596551+0000","last_became_active":"2024-09-16T07:38:56.511359+0000","last_became_peered":"2024-09-16T07:38:56.511359+0000","last_unstale":"2024-09-16T07:52:49.596551+0000","last_undegraded":"2024-09-16T07:52:49.596551+0000","last_fullsized":"2024-09-16T07:52:49.596551+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.15","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.598937+0000","last_change":"2024-09-16T07:38:56.584741+0000","last_active":"2024-09-16T07:52:49.598937+0000","last_peered":"2024-09-16T07:52:49.598937+0000","last_clean":"2024-09-16T07:52:49.598937+0000","last_became_active":"2024-09-16T07:38:56.572269+0000","last_became_peered":"2024-09-16T07:38:56.572269+0000","last_unstale":"2024-09-16T07:52:49.598937+0000","last_undegraded":"2024-09-16T07:52:49.598937+0000","last_fullsized":"2024-09-16T07:52:49.598937+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.14","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.614406+0000","last_change":"2024-09-16T07:38:56.607891+0000","last_active":"2024-09-16T07:52:49.614406+0000","last_peered":"2024-09-16T07:52:49.614406+0000","last_clean":"2024-09-16T07:52:49.614406+0000","last_became_active":"2024-09-16T07:38:56.597598+0000","last_became_peered":"2024-09-16T07:38:56.597598+0000","last_unstale":"2024-09-16T07:52:49.614406+0000","last_undegraded":"2024-09-16T07:52:49.614406+0000","last_fullsized":"2024-09-16T07:52:49.614406+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.13","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.610580+0000","last_change":"2024-09-16T07:38:56.620750+0000","last_active":"2024-09-16T07:52:49.610580+0000","last_peered":"2024-09-16T07:52:49.610580+0000","last_clean":"2024-09-16T07:52:49.610580+0000","last_became_active":"2024-09-16T07:38:56.612776+0000","last_became_peered":"2024-09-16T07:38:56.612776+0000","last_unstale":"2024-09-16T07:52:49.610580+0000","last_undegraded":"2024-09-16T07:52:49.610580+0000","last_fullsized":"2024-09-16T07:52:49.610580+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.12","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.592699+0000","last_change":"2024-09-16T07:38:56.568199+0000","last_active":"2024-09-16T07:52:49.592699+0000","last_peered":"2024-09-16T07:52:49.592699+0000","last_clean":"2024-09-16T07:52:49.592699+0000","last_became_active":"2024-09-16T07:38:56.549760+0000","last_became_peered":"2024-09-16T07:38:56.549760+0000","last_unstale":"2024-09-16T07:52:49.592699+0000","last_undegraded":"2024-09-16T07:52:49.592699+0000","last_fullsized":"2024-09-16T07:52:49.592699+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.11","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.629663+0000","last_change":"2024-09-16T07:38:56.635466+0000","last_active":"2024-09-16T07:52:49.629663+0000","last_peered":"2024-09-16T07:52:49.629663+0000","last_clean":"2024-09-16T07:52:49.629663+0000","last_became_active":"2024-09-16T07:38:56.627154+0000","last_became_peered":"2024-09-16T07:38:56.627154+0000","last_unstale":"2024-09-16T07:52:49.629663+0000","last_undegraded":"2024-09-16T07:52:49.629663+0000","last_fullsized":"2024-09-16T07:52:49.629663+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.10","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.643855+0000","last_change":"2024-09-16T07:38:56.589078+0000","last_active":"2024-09-16T07:52:49.643855+0000","last_peered":"2024-09-16T07:52:49.643855+0000","last_clean":"2024-09-16T07:52:49.643855+0000","last_became_active":"2024-09-16T07:38:56.582737+0000","last_became_peered":"2024-09-16T07:38:56.582737+0000","last_unstale":"2024-09-16T07:52:49.643855+0000","last_undegraded":"2024-09-16T07:52:49.643855+0000","last_fullsized":"2024-09-16T07:52:49.643855+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.f","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.632383+0000","last_change":"2024-09-16T07:38:56.647138+0000","last_active":"2024-09-16T07:52:49.632383+0000","last_peered":"2024-09-16T07:52:49.632383+0000","last_clean":"2024-09-16T07:52:49.632383+0000","last_became_active":"2024-09-16T07:38:56.634586+0000","last_became_peered":"2024-09-16T07:38:56.634586+0000","last_unstale":"2024-09-16T07:52:49.632383+0000","last_undegraded":"2024-09-16T07:52:49.632383+0000","last_fullsized":"2024-09-16T07:52:49.632383+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.e","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.604678+0000","last_change":"2024-09-16T07:38:56.563232+0000","last_active":"2024-09-16T07:52:49.604678+0000","last_peered":"2024-09-16T07:52:49.604678+0000","last_clean":"2024-09-16T07:52:49.604678+0000","last_became_active":"2024-09-16T07:38:56.543232+0000","last_became_peered":"2024-09-16T07:38:56.543232+0000","last_unstale":"2024-09-16T07:52:49.604678+0000","last_undegraded":"2024-09-16T07:52:49.604678+0000","last_fullsized":"2024-09-16T07:52:49.604678+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.d","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.610250+0000","last_change":"2024-09-16T07:38:56.548184+0000","last_active":"2024-09-16T07:52:49.610250+0000","last_peered":"2024-09-16T07:52:49.610250+0000","last_clean":"2024-09-16T07:52:49.610250+0000","last_became_active":"2024-09-16T07:38:56.537998+0000","last_became_peered":"2024-09-16T07:38:56.537998+0000","last_unstale":"2024-09-16T07:52:49.610250+0000","last_undegraded":"2024-09-16T07:52:49.610250+0000","last_fullsized":"2024-09-16T07:52:49.610250+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.c","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.626062+0000","last_change":"2024-09-16T07:38:56.600064+0000","last_active":"2024-09-16T07:52:49.626062+0000","last_peered":"2024-09-16T07:52:49.626062+0000","last_clean":"2024-09-16T07:52:49.626062+0000","last_became_active":"2024-09-16T07:38:56.587813+0000","last_became_peered":"2024-09-16T07:38:56.587813+0000","last_unstale":"2024-09-16T07:52:49.626062+0000","last_undegraded":"2024-09-16T07:52:49.626062+0000","last_fullsized":"2024-09-16T07:52:49.626062+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.b","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.617512+0000","last_change":"2024-09-16T07:38:56.605067+0000","last_active":"2024-09-16T07:52:49.617512+0000","last_peered":"2024-09-16T07:52:49.617512+0000","last_clean":"2024-09-16T07:52:49.617512+0000","last_became_active":"2024-09-16T07:38:56.593974+0000","last_became_peered":"2024-09-16T07:38:56.593974+0000","last_unstale":"2024-09-16T07:52:49.617512+0000","last_undegraded":"2024-09-16T07:52:49.617512+0000","last_fullsized":"2024-09-16T07:52:49.617512+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.a","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.595209+0000","last_change":"2024-09-16T07:38:56.536096+0000","last_active":"2024-09-16T07:52:49.595209+0000","last_peered":"2024-09-16T07:52:49.595209+0000","last_clean":"2024-09-16T07:52:49.595209+0000","last_became_active":"2024-09-16T07:38:56.523092+0000","last_became_peered":"2024-09-16T07:38:56.523092+0000","last_unstale":"2024-09-16T07:52:49.595209+0000","last_undegraded":"2024-09-16T07:52:49.595209+0000","last_fullsized":"2024-09-16T07:52:49.595209+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.9","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.611132+0000","last_change":"2024-09-16T07:38:56.552526+0000","last_active":"2024-09-16T07:52:49.611132+0000","last_peered":"2024-09-16T07:52:49.611132+0000","last_clean":"2024-09-16T07:52:49.611132+0000","last_became_active":"2024-09-16T07:38:56.545643+0000","last_became_peered":"2024-09-16T07:38:56.545643+0000","last_unstale":"2024-09-16T07:52:49.611132+0000","last_undegraded":"2024-09-16T07:52:49.611132+0000","last_fullsized":"2024-09-16T07:52:49.611132+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.8","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.609807+0000","last_change":"2024-09-16T07:38:56.657793+0000","last_active":"2024-09-16T07:52:49.609807+0000","last_peered":"2024-09-16T07:52:49.609807+0000","last_clean":"2024-09-16T07:52:49.609807+0000","last_became_active":"2024-09-16T07:38:56.651984+0000","last_became_peered":"2024-09-16T07:38:56.651984+0000","last_unstale":"2024-09-16T07:52:49.609807+0000","last_undegraded":"2024-09-16T07:52:49.609807+0000","last_fullsized":"2024-09-16T07:52:49.609807+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.7","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.601048+0000","last_change":"2024-09-16T07:38:56.624485+0000","last_active":"2024-09-16T07:52:49.601048+0000","last_peered":"2024-09-16T07:52:49.601048+0000","last_clean":"2024-09-16T07:52:49.601048+0000","last_became_active":"2024-09-16T07:38:56.616849+0000","last_became_peered":"2024-09-16T07:38:56.616849+0000","last_unstale":"2024-09-16T07:52:49.601048+0000","last_undegraded":"2024-09-16T07:52:49.601048+0000","last_fullsized":"2024-09-16T07:52:49.601048+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.6","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.644671+0000","last_change":"2024-09-16T07:38:56.531334+0000","last_active":"2024-09-16T07:52:49.644671+0000","last_peered":"2024-09-16T07:52:49.644671+0000","last_clean":"2024-09-16T07:52:49.644671+0000","last_became_active":"2024-09-16T07:38:56.520779+0000","last_became_peered":"2024-09-16T07:38:56.520779+0000","last_unstale":"2024-09-16T07:52:49.644671+0000","last_undegraded":"2024-09-16T07:52:49.644671+0000","last_fullsized":"2024-09-16T07:52:49.644671+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.5","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.600706+0000","last_change":"2024-09-16T07:38:56.590139+0000","last_active":"2024-09-16T07:52:49.600706+0000","last_peered":"2024-09-16T07:52:49.600706+0000","last_clean":"2024-09-16T07:52:49.600706+0000","last_became_active":"2024-09-16T07:38:56.578614+0000","last_became_peered":"2024-09-16T07:38:56.578614+0000","last_unstale":"2024-09-16T07:52:49.600706+0000","last_undegraded":"2024-09-16T07:52:49.600706+0000","last_fullsized":"2024-09-16T07:52:49.600706+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.4","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.628056+0000","last_change":"2024-09-16T07:38:56.684296+0000","last_active":"2024-09-16T07:52:49.628056+0000","last_peered":"2024-09-16T07:52:49.628056+0000","last_clean":"2024-09-16T07:52:49.628056+0000","last_became_active":"2024-09-16T07:38:56.678986+0000","last_became_peered":"2024-09-16T07:38:56.678986+0000","last_unstale":"2024-09-16T07:52:49.628056+0000","last_undegraded":"2024-09-16T07:52:49.628056+0000","last_fullsized":"2024-09-16T07:52:49.628056+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.3","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.623271+0000","last_change":"2024-09-16T07:38:56.574269+0000","last_active":"2024-09-16T07:52:49.623271+0000","last_peered":"2024-09-16T07:52:49.623271+0000","last_clean":"2024-09-16T07:52:49.623271+0000","last_became_active":"2024-09-16T07:38:56.558143+0000","last_became_peered":"2024-09-16T07:38:56.558143+0000","last_unstale":"2024-09-16T07:52:49.623271+0000","last_undegraded":"2024-09-16T07:52:49.623271+0000","last_fullsized":"2024-09-16T07:52:49.623271+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.2","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.611405+0000","last_change":"2024-09-16T07:38:56.563501+0000","last_active":"2024-09-16T07:52:49.611405+0000","last_peered":"2024-09-16T07:52:49.611405+0000","last_clean":"2024-09-16T07:52:49.611405+0000","last_became_active":"2024-09-16T07:38:56.539784+0000","last_became_peered":"2024-09-16T07:38:56.539784+0000","last_unstale":"2024-09-16T07:52:49.611405+0000","last_undegraded":"2024-09-16T07:52:49.611405+0000","last_fullsized":"2024-09-16T07:52:49.611405+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1","version":"239'7","reported_seq":1470,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.607080+0000","last_change":"2024-09-16T07:38:56.532354+0000","last_active":"2024-09-16T07:52:49.607080+0000","last_peered":"2024-09-16T07:52:49.607080+0000","last_clean":"2024-09-16T07:52:49.607080+0000","last_became_active":"2024-09-16T07:38:56.517409+0000","last_became_peered":"2024-09-16T07:38:56.517409+0000","last_unstale":"2024-09-16T07:52:49.607080+0000","last_undegraded":"2024-09-16T07:52:49.607080+0000","last_fullsized":"2024-09-16T07:52:49.607080+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.0","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.613719+0000","last_change":"2024-09-16T07:38:56.506449+0000","last_active":"2024-09-16T07:52:49.613719+0000","last_peered":"2024-09-16T07:52:49.613719+0000","last_clean":"2024-09-16T07:52:49.613719+0000","last_became_active":"2024-09-16T07:38:56.499378+0000","last_became_peered":"2024-09-16T07:38:56.499378+0000","last_unstale":"2024-09-16T07:52:49.613719+0000","last_undegraded":"2024-09-16T07:52:49.613719+0000","last_fullsized":"2024-09-16T07:52:49.613719+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":2136,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.598810+0000","last_change":"2024-09-16T07:33:55.962652+0000","last_active":"2024-09-16T07:52:49.598810+0000","last_peered":"2024-09-16T07:52:49.598810+0000","last_clean":"2024-09-16T07:52:49.598810+0000","last_became_active":"2024-09-16T07:33:53.988604+0000","last_became_peered":"2024-09-16T07:33:53.988604+0000","last_unstale":"2024-09-16T07:52:49.598810+0000","last_undegraded":"2024-09-16T07:52:49.598810+0000","last_fullsized":"2024-09-16T07:52:49.598810+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_clean_scrub_stamp":"2024-09-16T07:33:52.925999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":2136,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.609334+0000","last_change":"2024-09-16T07:33:55.963562+0000","last_active":"2024-09-16T07:52:49.609334+0000","last_peered":"2024-09-16T07:52:49.609334+0000","last_clean":"2024-09-16T07:52:49.609334+0000","last_became_active":"2024-09-16T07:33:53.999244+0000","last_became_peered":"2024-09-16T07:33:53.999244+0000","last_unstale":"2024-09-16T07:52:49.609334+0000","last_undegraded":"2024-09-16T07:52:49.609334+0000","last_fullsized":"2024-09-16T07:52:49.609334+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_clean_scrub_stamp":"2024-09-16T07:33:52.925999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":2136,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.602588+0000","last_change":"2024-09-16T07:33:55.964565+0000","last_active":"2024-09-16T07:52:49.602588+0000","last_peered":"2024-09-16T07:52:49.602588+0000","last_clean":"2024-09-16T07:52:49.602588+0000","last_became_active":"2024-09-16T07:33:54.001528+0000","last_became_peered":"2024-09-16T07:33:54.001528+0000","last_unstale":"2024-09-16T07:52:49.602588+0000","last_undegraded":"2024-09-16T07:52:49.602588+0000","last_fullsized":"2024-09-16T07:52:49.602588+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_clean_scrub_stamp":"2024-09-16T07:33:52.925999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":2136,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.600990+0000","last_change":"2024-09-16T07:33:55.961854+0000","last_active":"2024-09-16T07:52:49.600990+0000","last_peered":"2024-09-16T07:52:49.600990+0000","last_clean":"2024-09-16T07:52:49.600990+0000","last_became_active":"2024-09-16T07:33:53.989047+0000","last_became_peered":"2024-09-16T07:33:53.989047+0000","last_unstale":"2024-09-16T07:52:49.600990+0000","last_undegraded":"2024-09-16T07:52:49.600990+0000","last_fullsized":"2024-09-16T07:52:49.600990+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_clean_scrub_stamp":"2024-09-16T07:33:52.925999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":2138,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.639851+0000","last_change":"2024-09-16T07:33:55.962135+0000","last_active":"2024-09-16T07:52:49.639851+0000","last_peered":"2024-09-16T07:52:49.639851+0000","last_clean":"2024-09-16T07:52:49.639851+0000","last_became_active":"2024-09-16T07:33:53.989661+0000","last_became_peered":"2024-09-16T07:33:53.989661+0000","last_unstale":"2024-09-16T07:52:49.639851+0000","last_undegraded":"2024-09-16T07:52:49.639851+0000","last_fullsized":"2024-09-16T07:52:49.639851+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_clean_scrub_stamp":"2024-09-16T07:33:52.925999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":2136,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.592683+0000","last_change":"2024-09-16T07:33:55.962959+0000","last_active":"2024-09-16T07:52:49.592683+0000","last_peered":"2024-09-16T07:52:49.592683+0000","last_clean":"2024-09-16T07:52:49.592683+0000","last_became_active":"2024-09-16T07:33:54.001165+0000","last_became_peered":"2024-09-16T07:33:54.001165+0000","last_unstale":"2024-09-16T07:52:49.592683+0000","last_undegraded":"2024-09-16T07:52:49.592683+0000","last_fullsized":"2024-09-16T07:52:49.592683+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_clean_scrub_stamp":"2024-09-16T07:33:52.925999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":2136,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.611341+0000","last_change":"2024-09-16T07:33:55.962311+0000","last_active":"2024-09-16T07:52:49.611341+0000","last_peered":"2024-09-16T07:52:49.611341+0000","last_clean":"2024-09-16T07:52:49.611341+0000","last_became_active":"2024-09-16T07:33:53.998493+0000","last_became_peered":"2024-09-16T07:33:53.998493+0000","last_unstale":"2024-09-16T07:52:49.611341+0000","last_undegraded":"2024-09-16T07:52:49.611341+0000","last_fullsized":"2024-09-16T07:52:49.611341+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_clean_scrub_stamp":"2024-09-16T07:33:52.925999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":2137,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.606316+0000","last_change":"2024-09-16T07:33:55.965013+0000","last_active":"2024-09-16T07:52:49.606316+0000","last_peered":"2024-09-16T07:52:49.606316+0000","last_clean":"2024-09-16T07:52:49.606316+0000","last_became_active":"2024-09-16T07:33:54.007370+0000","last_became_peered":"2024-09-16T07:33:54.007370+0000","last_unstale":"2024-09-16T07:52:49.606316+0000","last_undegraded":"2024-09-16T07:52:49.606316+0000","last_fullsized":"2024-09-16T07:52:49.606316+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_clean_scrub_stamp":"2024-09-16T07:33:52.925999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":2208,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.598687+0000","last_change":"2024-09-16T07:33:51.972549+0000","last_active":"2024-09-16T07:52:49.598687+0000","last_peered":"2024-09-16T07:52:49.598687+0000","last_clean":"2024-09-16T07:52:49.598687+0000","last_became_active":"2024-09-16T07:33:51.963446+0000","last_became_peered":"2024-09-16T07:33:51.963446+0000","last_unstale":"2024-09-16T07:52:49.598687+0000","last_undegraded":"2024-09-16T07:52:49.598687+0000","last_fullsized":"2024-09-16T07:52:49.598687+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:50.923539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:50.923539+0000","last_clean_scrub_stamp":"2024-09-16T07:33:50.923539+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":75,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30044,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":63300,"kb_used_data":1780,"kb_used_omap":0,"kb_used_meta":61504,"kb_avail":94308540,"statfs":{"total":96636764160,"available":96571944960,"internally_reserved":0,"allocated":1822720,"data_stored":1158276,"data_compressed":59484,"data_compressed_allocated":81920,"data_compressed_original":634880,"omap_allocated":0,"internal_metadata":62980096},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":64668,"kb_used_data":1740,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94307172,"statfs":{"total":96636764160,"available":96570544128,"internally_reserved":0,"allocated":1781760,"data_stored":580807,"data_compressed":35328,"data_compressed_allocated":49152,"data_compressed_original":73728,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59084,"kb_used_data":1724,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94312756,"statfs":{"total":96636764160,"available":96576262144,"internally_reserved":0,"allocated":1765376,"data_stored":567913,"data_compressed":29440,"data_compressed_allocated":40960,"data_compressed_original":61440,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":68884,"kb_used_data":1796,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94302956,"statfs":{"total":96636764160,"available":96566226944,"internally_reserved":0,"allocated":1839104,"data_stored":1171170,"data_compressed":65372,"data_compressed_allocated":90112,"data_compressed_original":647168,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30044,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:52:51.579 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:52:51.686 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.683+0000 7fed83246640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:51.686 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.688+0000 7fed83246640 1 Processor -- start 2024-09-16T07:52:51.686 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.688+0000 7fed83246640 1 -- start start 2024-09-16T07:52:51.688 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.689+0000 7fed83246640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fed7c135570 0x7fed7c137990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:52:51.688 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.689+0000 7fed83246640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed7c098840 con 0x7fed7c132790 2024-09-16T07:52:51.688 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.689+0000 7fed83246640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fed7c09ac90 con 0x7fed7c135570 2024-09-16T07:52:51.689 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.689+0000 7fed7bfff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fed7c135570 0x7fed7c137990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:52:51.689 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.689+0000 7fed7bfff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fed7c135570 0x7fed7c137990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:45576/0 (socket says 172.21.15.121:45576) 2024-09-16T07:52:51.689 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.689+0000 7fed7bfff640 1 -- 172.21.15.121:0/1865715822 learned_addr learned my addr 172.21.15.121:0/1865715822 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:52:51.689 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.689+0000 7fed80fe2640 1 --1- 172.21.15.121:0/1865715822 >> v1:172.21.15.121:6789/0 conn(0x7fed7c132790 0x7fed7c132ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:53344/0 (socket says 172.21.15.121:53344) 2024-09-16T07:52:51.689 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.689+0000 7fed7bfff640 1 -- 172.21.15.121:0/1865715822 >> v1:172.21.15.121:6789/0 conn(0x7fed7c132790 legacy=0x7fed7c132ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:52:51.689 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.689+0000 7fed7bfff640 1 -- 172.21.15.121:0/1865715822 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed7c09cb70 con 0x7fed7c135570 2024-09-16T07:52:51.689 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.689+0000 7fed7bfff640 1 --2- 172.21.15.121:0/1865715822 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fed7c135570 0x7fed7c137990 crc :-1 s=READY pgs=12996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5916894b48c6b44e server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:52:51.689 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.690+0000 7fed7b7fe640 1 -- 172.21.15.121:0/1865715822 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fed6800add0 con 0x7fed7c135570 2024-09-16T07:52:51.689 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.690+0000 7fed7b7fe640 1 -- 172.21.15.121:0/1865715822 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fed6800f340 con 0x7fed7c135570 2024-09-16T07:52:51.689 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.690+0000 7fed7b7fe640 1 -- 172.21.15.121:0/1865715822 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fed6800f5e0 con 0x7fed7c135570 2024-09-16T07:52:51.690 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.690+0000 7fed83246640 1 -- 172.21.15.121:0/1865715822 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fed7c135570 msgr2=0x7fed7c137990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:52:51.690 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.690+0000 7fed83246640 1 --2- 172.21.15.121:0/1865715822 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fed7c135570 0x7fed7c137990 crc :-1 s=READY pgs=12996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:51.690 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.690+0000 7fed83246640 1 -- 172.21.15.121:0/1865715822 shutdown_connections 2024-09-16T07:52:51.690 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.690+0000 7fed83246640 1 --2- 172.21.15.121:0/1865715822 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fed7c135570 0x7fed7c137990 unknown :-1 s=CLOSED pgs=12996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:51.690 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.691+0000 7fed83246640 1 -- 172.21.15.121:0/1865715822 >> 172.21.15.121:0/1865715822 conn(0x7fed7c0a11f0 msgr2=0x7fed7c0a1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:52:51.691 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.691+0000 7fed83246640 1 -- 172.21.15.121:0/1865715822 shutdown_connections 2024-09-16T07:52:51.691 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.691+0000 7fed83246640 1 -- 172.21.15.121:0/1865715822 wait complete. 2024-09-16T07:52:51.691 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.691+0000 7fed83246640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:51.691 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.692+0000 7fed83246640 1 Processor -- start 2024-09-16T07:52:51.691 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.692+0000 7fed83246640 1 -- start start 2024-09-16T07:52:51.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.693+0000 7fed83246640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fed7c132790 0x7fed7c073750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:52:51.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.693+0000 7fed83246640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fed7c134710 con 0x7fed7c132790 2024-09-16T07:52:51.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.693+0000 7fed80fe2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fed7c132790 0x7fed7c073750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:52:51.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.693+0000 7fed80fe2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fed7c132790 0x7fed7c073750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:45578/0 (socket says 172.21.15.121:45578) 2024-09-16T07:52:51.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.693+0000 7fed80fe2640 1 -- 172.21.15.121:0/2637553927 learned_addr learned my addr 172.21.15.121:0/2637553927 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:52:51.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.694+0000 7fed80fe2640 1 -- 172.21.15.121:0/2637553927 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed7c073390 con 0x7fed7c132790 2024-09-16T07:52:51.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.694+0000 7fed80fe2640 1 --2- 172.21.15.121:0/2637553927 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fed7c132790 0x7fed7c073750 crc :-1 s=READY pgs=12997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:52:51.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.694+0000 7fed797fa640 1 -- 172.21.15.121:0/2637553927 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fed700059a0 con 0x7fed7c132790 2024-09-16T07:52:51.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.694+0000 7fed797fa640 1 -- 172.21.15.121:0/2637553927 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fed70005b00 con 0x7fed7c132790 2024-09-16T07:52:51.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.694+0000 7fed83246640 1 -- 172.21.15.121:0/2637553927 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed7c0749b0 con 0x7fed7c132790 2024-09-16T07:52:51.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.694+0000 7fed797fa640 1 -- 172.21.15.121:0/2637553927 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fed70005da0 con 0x7fed7c132790 2024-09-16T07:52:51.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.694+0000 7fed83246640 1 -- 172.21.15.121:0/2637553927 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed7c072fc0 con 0x7fed7c132790 2024-09-16T07:52:51.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.695+0000 7fed797fa640 1 -- 172.21.15.121:0/2637553927 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fed700070b0 con 0x7fed7c132790 2024-09-16T07:52:51.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.695+0000 7fed83246640 1 -- 172.21.15.121:0/2637553927 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed7c132ba0 con 0x7fed7c132790 2024-09-16T07:52:51.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.695+0000 7fed797fa640 1 --2- 172.21.15.121:0/2637553927 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fed6003e930 0x7fed60040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:52:51.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.695+0000 7fed797fa640 1 -- 172.21.15.121:0/2637553927 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(723..723 src has 620..723) ==== 3431+0+0 (crc 0 0 0) 0x7fed7004f940 con 0x7fed7c132790 2024-09-16T07:52:51.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.696+0000 7fed7bfff640 1 --2- 172.21.15.121:0/2637553927 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fed6003e930 0x7fed60040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:52:51.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.696+0000 7fed7bfff640 1 --2- 172.21.15.121:0/2637553927 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fed6003e930 0x7fed60040e40 crc :-1 s=READY pgs=3845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:52:51.699 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.700+0000 7fed797fa640 1 -- 172.21.15.121:0/2637553927 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fed7000dc60 con 0x7fed7c132790 2024-09-16T07:52:51.872 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.873+0000 7fed83246640 1 -- 172.21.15.121:0/2637553927 --> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fed7c130f50 con 0x7fed6003e930 2024-09-16T07:52:51.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.876+0000 7fed797fa640 1 -- 172.21.15.121:0/2637553927 <== mgr.4102 v2:172.21.15.172:6800/643901738 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+109227 (crc 0 0 0) 0x7fed6800aca0 con 0x7fed6003e930 2024-09-16T07:52:51.876 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:52:51.876 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-09-16T07:52:51.878 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.878+0000 7fed83246640 1 -- 172.21.15.121:0/2637553927 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fed6003e930 msgr2=0x7fed60040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:52:51.878 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.878+0000 7fed83246640 1 --2- 172.21.15.121:0/2637553927 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fed6003e930 0x7fed60040e40 crc :-1 s=READY pgs=3845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:51.878 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.878+0000 7fed83246640 1 -- 172.21.15.121:0/2637553927 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fed7c132790 msgr2=0x7fed7c073750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:52:51.878 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.878+0000 7fed83246640 1 --2- 172.21.15.121:0/2637553927 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fed7c132790 0x7fed7c073750 crc :-1 s=READY pgs=12997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:51.878 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.879+0000 7fed83246640 1 -- 172.21.15.121:0/2637553927 shutdown_connections 2024-09-16T07:52:51.878 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.879+0000 7fed83246640 1 --2- 172.21.15.121:0/2637553927 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fed6003e930 0x7fed60040e40 unknown :-1 s=CLOSED pgs=3845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:51.878 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.879+0000 7fed83246640 1 --2- 172.21.15.121:0/2637553927 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fed7c132790 0x7fed7c073750 unknown :-1 s=CLOSED pgs=12997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:51.878 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.879+0000 7fed83246640 1 -- 172.21.15.121:0/2637553927 >> 172.21.15.121:0/2637553927 conn(0x7fed7c0a11f0 msgr2=0x7fed7c131720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:52:51.878 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.879+0000 7fed83246640 1 -- 172.21.15.121:0/2637553927 shutdown_connections 2024-09-16T07:52:51.878 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.879+0000 7fed83246640 1 -- 172.21.15.121:0/2637553927 wait complete. 2024-09-16T07:52:51.888 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":1286,"stamp":"2024-09-16T07:52:51.129015+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590392,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":52,"num_write":88,"num_write_kb":1115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":62,"ondisk_log_size":62,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":255936,"kb_used_data":7040,"kb_used_omap":0,"kb_used_meta":248832,"kb_avail":377231424,"statfs":{"total":386547056640,"available":386284978176,"internally_reserved":0,"allocated":7208960,"data_stored":3478166,"data_compressed":189624,"data_compressed_allocated":262144,"data_compressed_original":1417216,"omap_allocated":0,"internal_metadata":254803968},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-321875,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-25,"num_write_kb":-325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002060"},"pg_stats":[{"pgid":"75.1f","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.604966+0000","last_change":"2024-09-16T07:38:56.550066+0000","last_active":"2024-09-16T07:52:49.604966+0000","last_peered":"2024-09-16T07:52:49.604966+0000","last_clean":"2024-09-16T07:52:49.604966+0000","last_became_active":"2024-09-16T07:38:56.541997+0000","last_became_peered":"2024-09-16T07:38:56.541997+0000","last_unstale":"2024-09-16T07:52:49.604966+0000","last_undegraded":"2024-09-16T07:52:49.604966+0000","last_fullsized":"2024-09-16T07:52:49.604966+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1e","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.627314+0000","last_change":"2024-09-16T07:38:56.566272+0000","last_active":"2024-09-16T07:52:49.627314+0000","last_peered":"2024-09-16T07:52:49.627314+0000","last_clean":"2024-09-16T07:52:49.627314+0000","last_became_active":"2024-09-16T07:38:56.548814+0000","last_became_peered":"2024-09-16T07:38:56.548814+0000","last_unstale":"2024-09-16T07:52:49.627314+0000","last_undegraded":"2024-09-16T07:52:49.627314+0000","last_fullsized":"2024-09-16T07:52:49.627314+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1d","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.614967+0000","last_change":"2024-09-16T07:38:56.550793+0000","last_active":"2024-09-16T07:52:49.614967+0000","last_peered":"2024-09-16T07:52:49.614967+0000","last_clean":"2024-09-16T07:52:49.614967+0000","last_became_active":"2024-09-16T07:38:56.543879+0000","last_became_peered":"2024-09-16T07:38:56.543879+0000","last_unstale":"2024-09-16T07:52:49.614967+0000","last_undegraded":"2024-09-16T07:52:49.614967+0000","last_fullsized":"2024-09-16T07:52:49.614967+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.1c","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.600522+0000","last_change":"2024-09-16T07:38:56.599574+0000","last_active":"2024-09-16T07:52:49.600522+0000","last_peered":"2024-09-16T07:52:49.600522+0000","last_clean":"2024-09-16T07:52:49.600522+0000","last_became_active":"2024-09-16T07:38:56.593078+0000","last_became_peered":"2024-09-16T07:38:56.593078+0000","last_unstale":"2024-09-16T07:52:49.600522+0000","last_undegraded":"2024-09-16T07:52:49.600522+0000","last_fullsized":"2024-09-16T07:52:49.600522+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1b","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.609809+0000","last_change":"2024-09-16T07:38:56.553575+0000","last_active":"2024-09-16T07:52:49.609809+0000","last_peered":"2024-09-16T07:52:49.609809+0000","last_clean":"2024-09-16T07:52:49.609809+0000","last_became_active":"2024-09-16T07:38:56.546684+0000","last_became_peered":"2024-09-16T07:38:56.546684+0000","last_unstale":"2024-09-16T07:52:49.609809+0000","last_undegraded":"2024-09-16T07:52:49.609809+0000","last_fullsized":"2024-09-16T07:52:49.609809+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1a","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.609607+0000","last_change":"2024-09-16T07:38:56.571451+0000","last_active":"2024-09-16T07:52:49.609607+0000","last_peered":"2024-09-16T07:52:49.609607+0000","last_clean":"2024-09-16T07:52:49.609607+0000","last_became_active":"2024-09-16T07:38:56.532518+0000","last_became_peered":"2024-09-16T07:38:56.532518+0000","last_unstale":"2024-09-16T07:52:49.609607+0000","last_undegraded":"2024-09-16T07:52:49.609607+0000","last_fullsized":"2024-09-16T07:52:49.609607+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.19","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.648724+0000","last_change":"2024-09-16T07:38:56.613450+0000","last_active":"2024-09-16T07:52:49.648724+0000","last_peered":"2024-09-16T07:52:49.648724+0000","last_clean":"2024-09-16T07:52:49.648724+0000","last_became_active":"2024-09-16T07:38:56.606292+0000","last_became_peered":"2024-09-16T07:38:56.606292+0000","last_unstale":"2024-09-16T07:52:49.648724+0000","last_undegraded":"2024-09-16T07:52:49.648724+0000","last_fullsized":"2024-09-16T07:52:49.648724+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.18","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.609181+0000","last_change":"2024-09-16T07:38:56.638294+0000","last_active":"2024-09-16T07:52:49.609181+0000","last_peered":"2024-09-16T07:52:49.609181+0000","last_clean":"2024-09-16T07:52:49.609181+0000","last_became_active":"2024-09-16T07:38:56.630903+0000","last_became_peered":"2024-09-16T07:38:56.630903+0000","last_unstale":"2024-09-16T07:52:49.609181+0000","last_undegraded":"2024-09-16T07:52:49.609181+0000","last_fullsized":"2024-09-16T07:52:49.609181+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.17","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.588474+0000","last_change":"2024-09-16T07:38:56.531333+0000","last_active":"2024-09-16T07:52:49.588474+0000","last_peered":"2024-09-16T07:52:49.588474+0000","last_clean":"2024-09-16T07:52:49.588474+0000","last_became_active":"2024-09-16T07:38:56.515359+0000","last_became_peered":"2024-09-16T07:38:56.515359+0000","last_unstale":"2024-09-16T07:52:49.588474+0000","last_undegraded":"2024-09-16T07:52:49.588474+0000","last_fullsized":"2024-09-16T07:52:49.588474+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.16","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.596551+0000","last_change":"2024-09-16T07:38:56.527850+0000","last_active":"2024-09-16T07:52:49.596551+0000","last_peered":"2024-09-16T07:52:49.596551+0000","last_clean":"2024-09-16T07:52:49.596551+0000","last_became_active":"2024-09-16T07:38:56.511359+0000","last_became_peered":"2024-09-16T07:38:56.511359+0000","last_unstale":"2024-09-16T07:52:49.596551+0000","last_undegraded":"2024-09-16T07:52:49.596551+0000","last_fullsized":"2024-09-16T07:52:49.596551+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.15","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.598937+0000","last_change":"2024-09-16T07:38:56.584741+0000","last_active":"2024-09-16T07:52:49.598937+0000","last_peered":"2024-09-16T07:52:49.598937+0000","last_clean":"2024-09-16T07:52:49.598937+0000","last_became_active":"2024-09-16T07:38:56.572269+0000","last_became_peered":"2024-09-16T07:38:56.572269+0000","last_unstale":"2024-09-16T07:52:49.598937+0000","last_undegraded":"2024-09-16T07:52:49.598937+0000","last_fullsized":"2024-09-16T07:52:49.598937+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.14","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.614406+0000","last_change":"2024-09-16T07:38:56.607891+0000","last_active":"2024-09-16T07:52:49.614406+0000","last_peered":"2024-09-16T07:52:49.614406+0000","last_clean":"2024-09-16T07:52:49.614406+0000","last_became_active":"2024-09-16T07:38:56.597598+0000","last_became_peered":"2024-09-16T07:38:56.597598+0000","last_unstale":"2024-09-16T07:52:49.614406+0000","last_undegraded":"2024-09-16T07:52:49.614406+0000","last_fullsized":"2024-09-16T07:52:49.614406+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.13","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.610580+0000","last_change":"2024-09-16T07:38:56.620750+0000","last_active":"2024-09-16T07:52:49.610580+0000","last_peered":"2024-09-16T07:52:49.610580+0000","last_clean":"2024-09-16T07:52:49.610580+0000","last_became_active":"2024-09-16T07:38:56.612776+0000","last_became_peered":"2024-09-16T07:38:56.612776+0000","last_unstale":"2024-09-16T07:52:49.610580+0000","last_undegraded":"2024-09-16T07:52:49.610580+0000","last_fullsized":"2024-09-16T07:52:49.610580+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.12","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.592699+0000","last_change":"2024-09-16T07:38:56.568199+0000","last_active":"2024-09-16T07:52:49.592699+0000","last_peered":"2024-09-16T07:52:49.592699+0000","last_clean":"2024-09-16T07:52:49.592699+0000","last_became_active":"2024-09-16T07:38:56.549760+0000","last_became_peered":"2024-09-16T07:38:56.549760+0000","last_unstale":"2024-09-16T07:52:49.592699+0000","last_undegraded":"2024-09-16T07:52:49.592699+0000","last_fullsized":"2024-09-16T07:52:49.592699+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.11","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.629663+0000","last_change":"2024-09-16T07:38:56.635466+0000","last_active":"2024-09-16T07:52:49.629663+0000","last_peered":"2024-09-16T07:52:49.629663+0000","last_clean":"2024-09-16T07:52:49.629663+0000","last_became_active":"2024-09-16T07:38:56.627154+0000","last_became_peered":"2024-09-16T07:38:56.627154+0000","last_unstale":"2024-09-16T07:52:49.629663+0000","last_undegraded":"2024-09-16T07:52:49.629663+0000","last_fullsized":"2024-09-16T07:52:49.629663+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.10","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.643855+0000","last_change":"2024-09-16T07:38:56.589078+0000","last_active":"2024-09-16T07:52:49.643855+0000","last_peered":"2024-09-16T07:52:49.643855+0000","last_clean":"2024-09-16T07:52:49.643855+0000","last_became_active":"2024-09-16T07:38:56.582737+0000","last_became_peered":"2024-09-16T07:38:56.582737+0000","last_unstale":"2024-09-16T07:52:49.643855+0000","last_undegraded":"2024-09-16T07:52:49.643855+0000","last_fullsized":"2024-09-16T07:52:49.643855+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.f","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.632383+0000","last_change":"2024-09-16T07:38:56.647138+0000","last_active":"2024-09-16T07:52:49.632383+0000","last_peered":"2024-09-16T07:52:49.632383+0000","last_clean":"2024-09-16T07:52:49.632383+0000","last_became_active":"2024-09-16T07:38:56.634586+0000","last_became_peered":"2024-09-16T07:38:56.634586+0000","last_unstale":"2024-09-16T07:52:49.632383+0000","last_undegraded":"2024-09-16T07:52:49.632383+0000","last_fullsized":"2024-09-16T07:52:49.632383+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.e","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.604678+0000","last_change":"2024-09-16T07:38:56.563232+0000","last_active":"2024-09-16T07:52:49.604678+0000","last_peered":"2024-09-16T07:52:49.604678+0000","last_clean":"2024-09-16T07:52:49.604678+0000","last_became_active":"2024-09-16T07:38:56.543232+0000","last_became_peered":"2024-09-16T07:38:56.543232+0000","last_unstale":"2024-09-16T07:52:49.604678+0000","last_undegraded":"2024-09-16T07:52:49.604678+0000","last_fullsized":"2024-09-16T07:52:49.604678+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.d","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.610250+0000","last_change":"2024-09-16T07:38:56.548184+0000","last_active":"2024-09-16T07:52:49.610250+0000","last_peered":"2024-09-16T07:52:49.610250+0000","last_clean":"2024-09-16T07:52:49.610250+0000","last_became_active":"2024-09-16T07:38:56.537998+0000","last_became_peered":"2024-09-16T07:38:56.537998+0000","last_unstale":"2024-09-16T07:52:49.610250+0000","last_undegraded":"2024-09-16T07:52:49.610250+0000","last_fullsized":"2024-09-16T07:52:49.610250+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.c","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.626062+0000","last_change":"2024-09-16T07:38:56.600064+0000","last_active":"2024-09-16T07:52:49.626062+0000","last_peered":"2024-09-16T07:52:49.626062+0000","last_clean":"2024-09-16T07:52:49.626062+0000","last_became_active":"2024-09-16T07:38:56.587813+0000","last_became_peered":"2024-09-16T07:38:56.587813+0000","last_unstale":"2024-09-16T07:52:49.626062+0000","last_undegraded":"2024-09-16T07:52:49.626062+0000","last_fullsized":"2024-09-16T07:52:49.626062+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.b","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.617512+0000","last_change":"2024-09-16T07:38:56.605067+0000","last_active":"2024-09-16T07:52:49.617512+0000","last_peered":"2024-09-16T07:52:49.617512+0000","last_clean":"2024-09-16T07:52:49.617512+0000","last_became_active":"2024-09-16T07:38:56.593974+0000","last_became_peered":"2024-09-16T07:38:56.593974+0000","last_unstale":"2024-09-16T07:52:49.617512+0000","last_undegraded":"2024-09-16T07:52:49.617512+0000","last_fullsized":"2024-09-16T07:52:49.617512+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.a","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.595209+0000","last_change":"2024-09-16T07:38:56.536096+0000","last_active":"2024-09-16T07:52:49.595209+0000","last_peered":"2024-09-16T07:52:49.595209+0000","last_clean":"2024-09-16T07:52:49.595209+0000","last_became_active":"2024-09-16T07:38:56.523092+0000","last_became_peered":"2024-09-16T07:38:56.523092+0000","last_unstale":"2024-09-16T07:52:49.595209+0000","last_undegraded":"2024-09-16T07:52:49.595209+0000","last_fullsized":"2024-09-16T07:52:49.595209+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.9","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.611132+0000","last_change":"2024-09-16T07:38:56.552526+0000","last_active":"2024-09-16T07:52:49.611132+0000","last_peered":"2024-09-16T07:52:49.611132+0000","last_clean":"2024-09-16T07:52:49.611132+0000","last_became_active":"2024-09-16T07:38:56.545643+0000","last_became_peered":"2024-09-16T07:38:56.545643+0000","last_unstale":"2024-09-16T07:52:49.611132+0000","last_undegraded":"2024-09-16T07:52:49.611132+0000","last_fullsized":"2024-09-16T07:52:49.611132+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.8","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.609807+0000","last_change":"2024-09-16T07:38:56.657793+0000","last_active":"2024-09-16T07:52:49.609807+0000","last_peered":"2024-09-16T07:52:49.609807+0000","last_clean":"2024-09-16T07:52:49.609807+0000","last_became_active":"2024-09-16T07:38:56.651984+0000","last_became_peered":"2024-09-16T07:38:56.651984+0000","last_unstale":"2024-09-16T07:52:49.609807+0000","last_undegraded":"2024-09-16T07:52:49.609807+0000","last_fullsized":"2024-09-16T07:52:49.609807+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.7","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.601048+0000","last_change":"2024-09-16T07:38:56.624485+0000","last_active":"2024-09-16T07:52:49.601048+0000","last_peered":"2024-09-16T07:52:49.601048+0000","last_clean":"2024-09-16T07:52:49.601048+0000","last_became_active":"2024-09-16T07:38:56.616849+0000","last_became_peered":"2024-09-16T07:38:56.616849+0000","last_unstale":"2024-09-16T07:52:49.601048+0000","last_undegraded":"2024-09-16T07:52:49.601048+0000","last_fullsized":"2024-09-16T07:52:49.601048+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.6","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.644671+0000","last_change":"2024-09-16T07:38:56.531334+0000","last_active":"2024-09-16T07:52:49.644671+0000","last_peered":"2024-09-16T07:52:49.644671+0000","last_clean":"2024-09-16T07:52:49.644671+0000","last_became_active":"2024-09-16T07:38:56.520779+0000","last_became_peered":"2024-09-16T07:38:56.520779+0000","last_unstale":"2024-09-16T07:52:49.644671+0000","last_undegraded":"2024-09-16T07:52:49.644671+0000","last_fullsized":"2024-09-16T07:52:49.644671+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.5","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.600706+0000","last_change":"2024-09-16T07:38:56.590139+0000","last_active":"2024-09-16T07:52:49.600706+0000","last_peered":"2024-09-16T07:52:49.600706+0000","last_clean":"2024-09-16T07:52:49.600706+0000","last_became_active":"2024-09-16T07:38:56.578614+0000","last_became_peered":"2024-09-16T07:38:56.578614+0000","last_unstale":"2024-09-16T07:52:49.600706+0000","last_undegraded":"2024-09-16T07:52:49.600706+0000","last_fullsized":"2024-09-16T07:52:49.600706+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.4","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.628056+0000","last_change":"2024-09-16T07:38:56.684296+0000","last_active":"2024-09-16T07:52:49.628056+0000","last_peered":"2024-09-16T07:52:49.628056+0000","last_clean":"2024-09-16T07:52:49.628056+0000","last_became_active":"2024-09-16T07:38:56.678986+0000","last_became_peered":"2024-09-16T07:38:56.678986+0000","last_unstale":"2024-09-16T07:52:49.628056+0000","last_undegraded":"2024-09-16T07:52:49.628056+0000","last_fullsized":"2024-09-16T07:52:49.628056+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.3","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.623271+0000","last_change":"2024-09-16T07:38:56.574269+0000","last_active":"2024-09-16T07:52:49.623271+0000","last_peered":"2024-09-16T07:52:49.623271+0000","last_clean":"2024-09-16T07:52:49.623271+0000","last_became_active":"2024-09-16T07:38:56.558143+0000","last_became_peered":"2024-09-16T07:38:56.558143+0000","last_unstale":"2024-09-16T07:52:49.623271+0000","last_undegraded":"2024-09-16T07:52:49.623271+0000","last_fullsized":"2024-09-16T07:52:49.623271+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.2","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.611405+0000","last_change":"2024-09-16T07:38:56.563501+0000","last_active":"2024-09-16T07:52:49.611405+0000","last_peered":"2024-09-16T07:52:49.611405+0000","last_clean":"2024-09-16T07:52:49.611405+0000","last_became_active":"2024-09-16T07:38:56.539784+0000","last_became_peered":"2024-09-16T07:38:56.539784+0000","last_unstale":"2024-09-16T07:52:49.611405+0000","last_undegraded":"2024-09-16T07:52:49.611405+0000","last_fullsized":"2024-09-16T07:52:49.611405+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1","version":"239'7","reported_seq":1470,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.607080+0000","last_change":"2024-09-16T07:38:56.532354+0000","last_active":"2024-09-16T07:52:49.607080+0000","last_peered":"2024-09-16T07:52:49.607080+0000","last_clean":"2024-09-16T07:52:49.607080+0000","last_became_active":"2024-09-16T07:38:56.517409+0000","last_became_peered":"2024-09-16T07:38:56.517409+0000","last_unstale":"2024-09-16T07:52:49.607080+0000","last_undegraded":"2024-09-16T07:52:49.607080+0000","last_fullsized":"2024-09-16T07:52:49.607080+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.0","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.613719+0000","last_change":"2024-09-16T07:38:56.506449+0000","last_active":"2024-09-16T07:52:49.613719+0000","last_peered":"2024-09-16T07:52:49.613719+0000","last_clean":"2024-09-16T07:52:49.613719+0000","last_became_active":"2024-09-16T07:38:56.499378+0000","last_became_peered":"2024-09-16T07:38:56.499378+0000","last_unstale":"2024-09-16T07:52:49.613719+0000","last_undegraded":"2024-09-16T07:52:49.613719+0000","last_fullsized":"2024-09-16T07:52:49.613719+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":2136,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.598810+0000","last_change":"2024-09-16T07:33:55.962652+0000","last_active":"2024-09-16T07:52:49.598810+0000","last_peered":"2024-09-16T07:52:49.598810+0000","last_clean":"2024-09-16T07:52:49.598810+0000","last_became_active":"2024-09-16T07:33:53.988604+0000","last_became_peered":"2024-09-16T07:33:53.988604+0000","last_unstale":"2024-09-16T07:52:49.598810+0000","last_undegraded":"2024-09-16T07:52:49.598810+0000","last_fullsized":"2024-09-16T07:52:49.598810+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_clean_scrub_stamp":"2024-09-16T07:33:52.925999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":2136,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.609334+0000","last_change":"2024-09-16T07:33:55.963562+0000","last_active":"2024-09-16T07:52:49.609334+0000","last_peered":"2024-09-16T07:52:49.609334+0000","last_clean":"2024-09-16T07:52:49.609334+0000","last_became_active":"2024-09-16T07:33:53.999244+0000","last_became_peered":"2024-09-16T07:33:53.999244+0000","last_unstale":"2024-09-16T07:52:49.609334+0000","last_undegraded":"2024-09-16T07:52:49.609334+0000","last_fullsized":"2024-09-16T07:52:49.609334+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_clean_scrub_stamp":"2024-09-16T07:33:52.925999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":2136,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.602588+0000","last_change":"2024-09-16T07:33:55.964565+0000","last_active":"2024-09-16T07:52:49.602588+0000","last_peered":"2024-09-16T07:52:49.602588+0000","last_clean":"2024-09-16T07:52:49.602588+0000","last_became_active":"2024-09-16T07:33:54.001528+0000","last_became_peered":"2024-09-16T07:33:54.001528+0000","last_unstale":"2024-09-16T07:52:49.602588+0000","last_undegraded":"2024-09-16T07:52:49.602588+0000","last_fullsized":"2024-09-16T07:52:49.602588+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_clean_scrub_stamp":"2024-09-16T07:33:52.925999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":2136,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.600990+0000","last_change":"2024-09-16T07:33:55.961854+0000","last_active":"2024-09-16T07:52:49.600990+0000","last_peered":"2024-09-16T07:52:49.600990+0000","last_clean":"2024-09-16T07:52:49.600990+0000","last_became_active":"2024-09-16T07:33:53.989047+0000","last_became_peered":"2024-09-16T07:33:53.989047+0000","last_unstale":"2024-09-16T07:52:49.600990+0000","last_undegraded":"2024-09-16T07:52:49.600990+0000","last_fullsized":"2024-09-16T07:52:49.600990+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_clean_scrub_stamp":"2024-09-16T07:33:52.925999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":2138,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.639851+0000","last_change":"2024-09-16T07:33:55.962135+0000","last_active":"2024-09-16T07:52:49.639851+0000","last_peered":"2024-09-16T07:52:49.639851+0000","last_clean":"2024-09-16T07:52:49.639851+0000","last_became_active":"2024-09-16T07:33:53.989661+0000","last_became_peered":"2024-09-16T07:33:53.989661+0000","last_unstale":"2024-09-16T07:52:49.639851+0000","last_undegraded":"2024-09-16T07:52:49.639851+0000","last_fullsized":"2024-09-16T07:52:49.639851+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_clean_scrub_stamp":"2024-09-16T07:33:52.925999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":2136,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.592683+0000","last_change":"2024-09-16T07:33:55.962959+0000","last_active":"2024-09-16T07:52:49.592683+0000","last_peered":"2024-09-16T07:52:49.592683+0000","last_clean":"2024-09-16T07:52:49.592683+0000","last_became_active":"2024-09-16T07:33:54.001165+0000","last_became_peered":"2024-09-16T07:33:54.001165+0000","last_unstale":"2024-09-16T07:52:49.592683+0000","last_undegraded":"2024-09-16T07:52:49.592683+0000","last_fullsized":"2024-09-16T07:52:49.592683+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_clean_scrub_stamp":"2024-09-16T07:33:52.925999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":2136,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.611341+0000","last_change":"2024-09-16T07:33:55.962311+0000","last_active":"2024-09-16T07:52:49.611341+0000","last_peered":"2024-09-16T07:52:49.611341+0000","last_clean":"2024-09-16T07:52:49.611341+0000","last_became_active":"2024-09-16T07:33:53.998493+0000","last_became_peered":"2024-09-16T07:33:53.998493+0000","last_unstale":"2024-09-16T07:52:49.611341+0000","last_undegraded":"2024-09-16T07:52:49.611341+0000","last_fullsized":"2024-09-16T07:52:49.611341+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_clean_scrub_stamp":"2024-09-16T07:33:52.925999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":2137,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.606316+0000","last_change":"2024-09-16T07:33:55.965013+0000","last_active":"2024-09-16T07:52:49.606316+0000","last_peered":"2024-09-16T07:52:49.606316+0000","last_clean":"2024-09-16T07:52:49.606316+0000","last_became_active":"2024-09-16T07:33:54.007370+0000","last_became_peered":"2024-09-16T07:33:54.007370+0000","last_unstale":"2024-09-16T07:52:49.606316+0000","last_undegraded":"2024-09-16T07:52:49.606316+0000","last_fullsized":"2024-09-16T07:52:49.606316+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_clean_scrub_stamp":"2024-09-16T07:33:52.925999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":2208,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.598687+0000","last_change":"2024-09-16T07:33:51.972549+0000","last_active":"2024-09-16T07:52:49.598687+0000","last_peered":"2024-09-16T07:52:49.598687+0000","last_clean":"2024-09-16T07:52:49.598687+0000","last_became_active":"2024-09-16T07:33:51.963446+0000","last_became_peered":"2024-09-16T07:33:51.963446+0000","last_unstale":"2024-09-16T07:52:49.598687+0000","last_undegraded":"2024-09-16T07:52:49.598687+0000","last_fullsized":"2024-09-16T07:52:49.598687+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:50.923539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:50.923539+0000","last_clean_scrub_stamp":"2024-09-16T07:33:50.923539+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":75,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30044,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":63300,"kb_used_data":1780,"kb_used_omap":0,"kb_used_meta":61504,"kb_avail":94308540,"statfs":{"total":96636764160,"available":96571944960,"internally_reserved":0,"allocated":1822720,"data_stored":1158276,"data_compressed":59484,"data_compressed_allocated":81920,"data_compressed_original":634880,"omap_allocated":0,"internal_metadata":62980096},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":64668,"kb_used_data":1740,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94307172,"statfs":{"total":96636764160,"available":96570544128,"internally_reserved":0,"allocated":1781760,"data_stored":580807,"data_compressed":35328,"data_compressed_allocated":49152,"data_compressed_original":73728,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59084,"kb_used_data":1724,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94312756,"statfs":{"total":96636764160,"available":96576262144,"internally_reserved":0,"allocated":1765376,"data_stored":567913,"data_compressed":29440,"data_compressed_allocated":40960,"data_compressed_original":61440,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":68884,"kb_used_data":1796,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94302956,"statfs":{"total":96636764160,"available":96566226944,"internally_reserved":0,"allocated":1839104,"data_stored":1171170,"data_compressed":65372,"data_compressed_allocated":90112,"data_compressed_original":647168,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30044,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:52:51.890 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-16T07:52:51.891 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:52:51.999 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:51.996+0000 7ff949591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:52.000 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.001+0000 7ff949591640 1 Processor -- start 2024-09-16T07:52:52.000 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.001+0000 7ff949591640 1 -- start start 2024-09-16T07:52:52.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.002+0000 7ff949591640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff9441360f0 0x7ff944136500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:52:52.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.002+0000 7ff949591640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9440a5c40 con 0x7ff94409e170 2024-09-16T07:52:52.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.002+0000 7ff949591640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7ff9440a6010 con 0x7ff9441360f0 2024-09-16T07:52:52.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.002+0000 7ff942ffd640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff9441360f0 0x7ff944136500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:52:52.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.002+0000 7ff942ffd640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff9441360f0 0x7ff944136500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:45586/0 (socket says 172.21.15.121:45586) 2024-09-16T07:52:52.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.002+0000 7ff93a7fc640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7ff94409e170 0x7ff94409e580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:53360/0 (socket says 172.21.15.121:53360) 2024-09-16T07:52:52.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.002+0000 7ff942ffd640 1 -- 172.21.15.121:0/675973015 learned_addr learned my addr 172.21.15.121:0/675973015 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:52:52.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.003+0000 7ff942ffd640 1 -- 172.21.15.121:0/675973015 >> v1:172.21.15.121:6789/0 conn(0x7ff94409e170 legacy=0x7ff94409e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:52:52.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.003+0000 7ff942ffd640 1 -- 172.21.15.121:0/675973015 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff94409f510 con 0x7ff9441360f0 2024-09-16T07:52:52.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.003+0000 7ff942ffd640 1 --2- 172.21.15.121:0/675973015 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9441360f0 0x7ff944136500 crc :-1 s=READY pgs=12999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9604d04c53fdc10a server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:52:52.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.003+0000 7ff9427fc640 1 -- 172.21.15.121:0/675973015 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff934009e50 con 0x7ff9441360f0 2024-09-16T07:52:52.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.003+0000 7ff9427fc640 1 -- 172.21.15.121:0/675973015 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff93400e230 con 0x7ff9441360f0 2024-09-16T07:52:52.003 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.003+0000 7ff9427fc640 1 -- 172.21.15.121:0/675973015 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff93400e4d0 con 0x7ff9441360f0 2024-09-16T07:52:52.003 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.004+0000 7ff949591640 1 -- 172.21.15.121:0/675973015 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9441360f0 msgr2=0x7ff944136500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:52:52.004 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.004+0000 7ff949591640 1 --2- 172.21.15.121:0/675973015 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9441360f0 0x7ff944136500 crc :-1 s=READY pgs=12999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:52.004 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.004+0000 7ff949591640 1 -- 172.21.15.121:0/675973015 shutdown_connections 2024-09-16T07:52:52.004 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.004+0000 7ff949591640 1 --2- 172.21.15.121:0/675973015 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9441360f0 0x7ff944136500 unknown :-1 s=CLOSED pgs=12999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:52.004 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.004+0000 7ff949591640 1 -- 172.21.15.121:0/675973015 >> 172.21.15.121:0/675973015 conn(0x7ff94406f850 msgr2=0x7ff94409ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:52:52.004 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.004+0000 7ff949591640 1 -- 172.21.15.121:0/675973015 shutdown_connections 2024-09-16T07:52:52.004 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.004+0000 7ff949591640 1 -- 172.21.15.121:0/675973015 wait complete. 2024-09-16T07:52:52.004 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.004+0000 7ff949591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:52.004 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.005+0000 7ff949591640 1 Processor -- start 2024-09-16T07:52:52.005 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.006+0000 7ff949591640 1 -- start start 2024-09-16T07:52:52.006 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.007+0000 7ff949591640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff94409e170 0x7ff9441250c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:52:52.006 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.007+0000 7ff949591640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff9441272d0 con 0x7ff94409e170 2024-09-16T07:52:52.006 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.007+0000 7ff942ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff94409e170 0x7ff9441250c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:52:52.006 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.007+0000 7ff942ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff94409e170 0x7ff9441250c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:45596/0 (socket says 172.21.15.121:45596) 2024-09-16T07:52:52.006 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.007+0000 7ff942ffd640 1 -- 172.21.15.121:0/3280081702 learned_addr learned my addr 172.21.15.121:0/3280081702 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:52:52.006 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.007+0000 7ff942ffd640 1 -- 172.21.15.121:0/3280081702 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff944126a10 con 0x7ff94409e170 2024-09-16T07:52:52.006 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.007+0000 7ff942ffd640 1 --2- 172.21.15.121:0/3280081702 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff94409e170 0x7ff9441250c0 crc :-1 s=READY pgs=13000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:52:52.006 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.007+0000 7ff93bfff640 1 -- 172.21.15.121:0/3280081702 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff93400eda0 con 0x7ff94409e170 2024-09-16T07:52:52.007 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.007+0000 7ff93bfff640 1 -- 172.21.15.121:0/3280081702 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff934015420 con 0x7ff94409e170 2024-09-16T07:52:52.007 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.007+0000 7ff949591640 1 -- 172.21.15.121:0/3280081702 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff944128380 con 0x7ff94409e170 2024-09-16T07:52:52.007 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.007+0000 7ff93bfff640 1 -- 172.21.15.121:0/3280081702 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff9340156c0 con 0x7ff94409e170 2024-09-16T07:52:52.007 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.007+0000 7ff949591640 1 -- 172.21.15.121:0/3280081702 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff944128b20 con 0x7ff94409e170 2024-09-16T07:52:52.007 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.008+0000 7ff949591640 1 -- 172.21.15.121:0/3280081702 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff944128de0 con 0x7ff94409e170 2024-09-16T07:52:52.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.008+0000 7ff93bfff640 1 -- 172.21.15.121:0/3280081702 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7ff9340158c0 con 0x7ff94409e170 2024-09-16T07:52:52.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.009+0000 7ff93bfff640 1 --2- 172.21.15.121:0/3280081702 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7ff92403e910 0x7ff924040e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:52:52.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.009+0000 7ff93bfff640 1 -- 172.21.15.121:0/3280081702 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(723..723 src has 620..723) ==== 3431+0+0 (crc 0 0 0) 0x7ff934051100 con 0x7ff94409e170 2024-09-16T07:52:52.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.009+0000 7ff93a7fc640 1 --2- 172.21.15.121:0/3280081702 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7ff92403e910 0x7ff924040e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:52:52.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.010+0000 7ff93a7fc640 1 --2- 172.21.15.121:0/3280081702 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7ff92403e910 0x7ff924040e20 crc :-1 s=READY pgs=3846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:52:52.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.014+0000 7ff93bfff640 1 -- 172.21.15.121:0/3280081702 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7ff93400f2a0 con 0x7ff94409e170 2024-09-16T07:52:52.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.186+0000 7ff949591640 1 -- 172.21.15.121:0/3280081702 --> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff944128210 con 0x7ff92403e910 2024-09-16T07:52:52.188 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.189+0000 7ff93bfff640 1 -- 172.21.15.121:0/3280081702 <== mgr.4102 v2:172.21.15.172:6800/643901738 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+109227 (crc 0 0 0) 0x7ff944128210 con 0x7ff92403e910 2024-09-16T07:52:52.189 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:52:52.189 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-09-16T07:52:52.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.192+0000 7ff949591640 1 -- 172.21.15.121:0/3280081702 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7ff92403e910 msgr2=0x7ff924040e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:52:52.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.192+0000 7ff949591640 1 --2- 172.21.15.121:0/3280081702 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7ff92403e910 0x7ff924040e20 crc :-1 s=READY pgs=3846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:52.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.192+0000 7ff949591640 1 -- 172.21.15.121:0/3280081702 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff94409e170 msgr2=0x7ff9441250c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:52:52.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.192+0000 7ff949591640 1 --2- 172.21.15.121:0/3280081702 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff94409e170 0x7ff9441250c0 crc :-1 s=READY pgs=13000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:52.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.192+0000 7ff949591640 1 -- 172.21.15.121:0/3280081702 shutdown_connections 2024-09-16T07:52:52.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.192+0000 7ff949591640 1 --2- 172.21.15.121:0/3280081702 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7ff92403e910 0x7ff924040e20 unknown :-1 s=CLOSED pgs=3846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:52.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.192+0000 7ff949591640 1 --2- 172.21.15.121:0/3280081702 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff94409e170 0x7ff9441250c0 unknown :-1 s=CLOSED pgs=13000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:52.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.192+0000 7ff949591640 1 -- 172.21.15.121:0/3280081702 >> 172.21.15.121:0/3280081702 conn(0x7ff94406f850 msgr2=0x7ff9440a3d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:52:52.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.192+0000 7ff949591640 1 -- 172.21.15.121:0/3280081702 shutdown_connections 2024-09-16T07:52:52.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.192+0000 7ff949591640 1 -- 172.21.15.121:0/3280081702 wait complete. 2024-09-16T07:52:52.202 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":1286,"stamp":"2024-09-16T07:52:51.129015+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590392,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":52,"num_write":88,"num_write_kb":1115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":62,"ondisk_log_size":62,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":255936,"kb_used_data":7040,"kb_used_omap":0,"kb_used_meta":248832,"kb_avail":377231424,"statfs":{"total":386547056640,"available":386284978176,"internally_reserved":0,"allocated":7208960,"data_stored":3478166,"data_compressed":189624,"data_compressed_allocated":262144,"data_compressed_original":1417216,"omap_allocated":0,"internal_metadata":254803968},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-321875,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-25,"num_write_kb":-325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002060"},"pg_stats":[{"pgid":"75.1f","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.604966+0000","last_change":"2024-09-16T07:38:56.550066+0000","last_active":"2024-09-16T07:52:49.604966+0000","last_peered":"2024-09-16T07:52:49.604966+0000","last_clean":"2024-09-16T07:52:49.604966+0000","last_became_active":"2024-09-16T07:38:56.541997+0000","last_became_peered":"2024-09-16T07:38:56.541997+0000","last_unstale":"2024-09-16T07:52:49.604966+0000","last_undegraded":"2024-09-16T07:52:49.604966+0000","last_fullsized":"2024-09-16T07:52:49.604966+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1e","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.627314+0000","last_change":"2024-09-16T07:38:56.566272+0000","last_active":"2024-09-16T07:52:49.627314+0000","last_peered":"2024-09-16T07:52:49.627314+0000","last_clean":"2024-09-16T07:52:49.627314+0000","last_became_active":"2024-09-16T07:38:56.548814+0000","last_became_peered":"2024-09-16T07:38:56.548814+0000","last_unstale":"2024-09-16T07:52:49.627314+0000","last_undegraded":"2024-09-16T07:52:49.627314+0000","last_fullsized":"2024-09-16T07:52:49.627314+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1d","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.614967+0000","last_change":"2024-09-16T07:38:56.550793+0000","last_active":"2024-09-16T07:52:49.614967+0000","last_peered":"2024-09-16T07:52:49.614967+0000","last_clean":"2024-09-16T07:52:49.614967+0000","last_became_active":"2024-09-16T07:38:56.543879+0000","last_became_peered":"2024-09-16T07:38:56.543879+0000","last_unstale":"2024-09-16T07:52:49.614967+0000","last_undegraded":"2024-09-16T07:52:49.614967+0000","last_fullsized":"2024-09-16T07:52:49.614967+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.1c","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.600522+0000","last_change":"2024-09-16T07:38:56.599574+0000","last_active":"2024-09-16T07:52:49.600522+0000","last_peered":"2024-09-16T07:52:49.600522+0000","last_clean":"2024-09-16T07:52:49.600522+0000","last_became_active":"2024-09-16T07:38:56.593078+0000","last_became_peered":"2024-09-16T07:38:56.593078+0000","last_unstale":"2024-09-16T07:52:49.600522+0000","last_undegraded":"2024-09-16T07:52:49.600522+0000","last_fullsized":"2024-09-16T07:52:49.600522+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1b","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.609809+0000","last_change":"2024-09-16T07:38:56.553575+0000","last_active":"2024-09-16T07:52:49.609809+0000","last_peered":"2024-09-16T07:52:49.609809+0000","last_clean":"2024-09-16T07:52:49.609809+0000","last_became_active":"2024-09-16T07:38:56.546684+0000","last_became_peered":"2024-09-16T07:38:56.546684+0000","last_unstale":"2024-09-16T07:52:49.609809+0000","last_undegraded":"2024-09-16T07:52:49.609809+0000","last_fullsized":"2024-09-16T07:52:49.609809+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1a","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.609607+0000","last_change":"2024-09-16T07:38:56.571451+0000","last_active":"2024-09-16T07:52:49.609607+0000","last_peered":"2024-09-16T07:52:49.609607+0000","last_clean":"2024-09-16T07:52:49.609607+0000","last_became_active":"2024-09-16T07:38:56.532518+0000","last_became_peered":"2024-09-16T07:38:56.532518+0000","last_unstale":"2024-09-16T07:52:49.609607+0000","last_undegraded":"2024-09-16T07:52:49.609607+0000","last_fullsized":"2024-09-16T07:52:49.609607+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.19","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.648724+0000","last_change":"2024-09-16T07:38:56.613450+0000","last_active":"2024-09-16T07:52:49.648724+0000","last_peered":"2024-09-16T07:52:49.648724+0000","last_clean":"2024-09-16T07:52:49.648724+0000","last_became_active":"2024-09-16T07:38:56.606292+0000","last_became_peered":"2024-09-16T07:38:56.606292+0000","last_unstale":"2024-09-16T07:52:49.648724+0000","last_undegraded":"2024-09-16T07:52:49.648724+0000","last_fullsized":"2024-09-16T07:52:49.648724+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.18","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.609181+0000","last_change":"2024-09-16T07:38:56.638294+0000","last_active":"2024-09-16T07:52:49.609181+0000","last_peered":"2024-09-16T07:52:49.609181+0000","last_clean":"2024-09-16T07:52:49.609181+0000","last_became_active":"2024-09-16T07:38:56.630903+0000","last_became_peered":"2024-09-16T07:38:56.630903+0000","last_unstale":"2024-09-16T07:52:49.609181+0000","last_undegraded":"2024-09-16T07:52:49.609181+0000","last_fullsized":"2024-09-16T07:52:49.609181+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.17","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.588474+0000","last_change":"2024-09-16T07:38:56.531333+0000","last_active":"2024-09-16T07:52:49.588474+0000","last_peered":"2024-09-16T07:52:49.588474+0000","last_clean":"2024-09-16T07:52:49.588474+0000","last_became_active":"2024-09-16T07:38:56.515359+0000","last_became_peered":"2024-09-16T07:38:56.515359+0000","last_unstale":"2024-09-16T07:52:49.588474+0000","last_undegraded":"2024-09-16T07:52:49.588474+0000","last_fullsized":"2024-09-16T07:52:49.588474+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.16","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.596551+0000","last_change":"2024-09-16T07:38:56.527850+0000","last_active":"2024-09-16T07:52:49.596551+0000","last_peered":"2024-09-16T07:52:49.596551+0000","last_clean":"2024-09-16T07:52:49.596551+0000","last_became_active":"2024-09-16T07:38:56.511359+0000","last_became_peered":"2024-09-16T07:38:56.511359+0000","last_unstale":"2024-09-16T07:52:49.596551+0000","last_undegraded":"2024-09-16T07:52:49.596551+0000","last_fullsized":"2024-09-16T07:52:49.596551+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.15","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.598937+0000","last_change":"2024-09-16T07:38:56.584741+0000","last_active":"2024-09-16T07:52:49.598937+0000","last_peered":"2024-09-16T07:52:49.598937+0000","last_clean":"2024-09-16T07:52:49.598937+0000","last_became_active":"2024-09-16T07:38:56.572269+0000","last_became_peered":"2024-09-16T07:38:56.572269+0000","last_unstale":"2024-09-16T07:52:49.598937+0000","last_undegraded":"2024-09-16T07:52:49.598937+0000","last_fullsized":"2024-09-16T07:52:49.598937+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.14","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.614406+0000","last_change":"2024-09-16T07:38:56.607891+0000","last_active":"2024-09-16T07:52:49.614406+0000","last_peered":"2024-09-16T07:52:49.614406+0000","last_clean":"2024-09-16T07:52:49.614406+0000","last_became_active":"2024-09-16T07:38:56.597598+0000","last_became_peered":"2024-09-16T07:38:56.597598+0000","last_unstale":"2024-09-16T07:52:49.614406+0000","last_undegraded":"2024-09-16T07:52:49.614406+0000","last_fullsized":"2024-09-16T07:52:49.614406+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.13","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.610580+0000","last_change":"2024-09-16T07:38:56.620750+0000","last_active":"2024-09-16T07:52:49.610580+0000","last_peered":"2024-09-16T07:52:49.610580+0000","last_clean":"2024-09-16T07:52:49.610580+0000","last_became_active":"2024-09-16T07:38:56.612776+0000","last_became_peered":"2024-09-16T07:38:56.612776+0000","last_unstale":"2024-09-16T07:52:49.610580+0000","last_undegraded":"2024-09-16T07:52:49.610580+0000","last_fullsized":"2024-09-16T07:52:49.610580+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.12","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.592699+0000","last_change":"2024-09-16T07:38:56.568199+0000","last_active":"2024-09-16T07:52:49.592699+0000","last_peered":"2024-09-16T07:52:49.592699+0000","last_clean":"2024-09-16T07:52:49.592699+0000","last_became_active":"2024-09-16T07:38:56.549760+0000","last_became_peered":"2024-09-16T07:38:56.549760+0000","last_unstale":"2024-09-16T07:52:49.592699+0000","last_undegraded":"2024-09-16T07:52:49.592699+0000","last_fullsized":"2024-09-16T07:52:49.592699+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.11","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.629663+0000","last_change":"2024-09-16T07:38:56.635466+0000","last_active":"2024-09-16T07:52:49.629663+0000","last_peered":"2024-09-16T07:52:49.629663+0000","last_clean":"2024-09-16T07:52:49.629663+0000","last_became_active":"2024-09-16T07:38:56.627154+0000","last_became_peered":"2024-09-16T07:38:56.627154+0000","last_unstale":"2024-09-16T07:52:49.629663+0000","last_undegraded":"2024-09-16T07:52:49.629663+0000","last_fullsized":"2024-09-16T07:52:49.629663+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.10","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.643855+0000","last_change":"2024-09-16T07:38:56.589078+0000","last_active":"2024-09-16T07:52:49.643855+0000","last_peered":"2024-09-16T07:52:49.643855+0000","last_clean":"2024-09-16T07:52:49.643855+0000","last_became_active":"2024-09-16T07:38:56.582737+0000","last_became_peered":"2024-09-16T07:38:56.582737+0000","last_unstale":"2024-09-16T07:52:49.643855+0000","last_undegraded":"2024-09-16T07:52:49.643855+0000","last_fullsized":"2024-09-16T07:52:49.643855+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.f","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.632383+0000","last_change":"2024-09-16T07:38:56.647138+0000","last_active":"2024-09-16T07:52:49.632383+0000","last_peered":"2024-09-16T07:52:49.632383+0000","last_clean":"2024-09-16T07:52:49.632383+0000","last_became_active":"2024-09-16T07:38:56.634586+0000","last_became_peered":"2024-09-16T07:38:56.634586+0000","last_unstale":"2024-09-16T07:52:49.632383+0000","last_undegraded":"2024-09-16T07:52:49.632383+0000","last_fullsized":"2024-09-16T07:52:49.632383+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.e","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.604678+0000","last_change":"2024-09-16T07:38:56.563232+0000","last_active":"2024-09-16T07:52:49.604678+0000","last_peered":"2024-09-16T07:52:49.604678+0000","last_clean":"2024-09-16T07:52:49.604678+0000","last_became_active":"2024-09-16T07:38:56.543232+0000","last_became_peered":"2024-09-16T07:38:56.543232+0000","last_unstale":"2024-09-16T07:52:49.604678+0000","last_undegraded":"2024-09-16T07:52:49.604678+0000","last_fullsized":"2024-09-16T07:52:49.604678+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.d","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.610250+0000","last_change":"2024-09-16T07:38:56.548184+0000","last_active":"2024-09-16T07:52:49.610250+0000","last_peered":"2024-09-16T07:52:49.610250+0000","last_clean":"2024-09-16T07:52:49.610250+0000","last_became_active":"2024-09-16T07:38:56.537998+0000","last_became_peered":"2024-09-16T07:38:56.537998+0000","last_unstale":"2024-09-16T07:52:49.610250+0000","last_undegraded":"2024-09-16T07:52:49.610250+0000","last_fullsized":"2024-09-16T07:52:49.610250+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.c","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.626062+0000","last_change":"2024-09-16T07:38:56.600064+0000","last_active":"2024-09-16T07:52:49.626062+0000","last_peered":"2024-09-16T07:52:49.626062+0000","last_clean":"2024-09-16T07:52:49.626062+0000","last_became_active":"2024-09-16T07:38:56.587813+0000","last_became_peered":"2024-09-16T07:38:56.587813+0000","last_unstale":"2024-09-16T07:52:49.626062+0000","last_undegraded":"2024-09-16T07:52:49.626062+0000","last_fullsized":"2024-09-16T07:52:49.626062+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.b","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.617512+0000","last_change":"2024-09-16T07:38:56.605067+0000","last_active":"2024-09-16T07:52:49.617512+0000","last_peered":"2024-09-16T07:52:49.617512+0000","last_clean":"2024-09-16T07:52:49.617512+0000","last_became_active":"2024-09-16T07:38:56.593974+0000","last_became_peered":"2024-09-16T07:38:56.593974+0000","last_unstale":"2024-09-16T07:52:49.617512+0000","last_undegraded":"2024-09-16T07:52:49.617512+0000","last_fullsized":"2024-09-16T07:52:49.617512+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.a","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.595209+0000","last_change":"2024-09-16T07:38:56.536096+0000","last_active":"2024-09-16T07:52:49.595209+0000","last_peered":"2024-09-16T07:52:49.595209+0000","last_clean":"2024-09-16T07:52:49.595209+0000","last_became_active":"2024-09-16T07:38:56.523092+0000","last_became_peered":"2024-09-16T07:38:56.523092+0000","last_unstale":"2024-09-16T07:52:49.595209+0000","last_undegraded":"2024-09-16T07:52:49.595209+0000","last_fullsized":"2024-09-16T07:52:49.595209+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.9","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.611132+0000","last_change":"2024-09-16T07:38:56.552526+0000","last_active":"2024-09-16T07:52:49.611132+0000","last_peered":"2024-09-16T07:52:49.611132+0000","last_clean":"2024-09-16T07:52:49.611132+0000","last_became_active":"2024-09-16T07:38:56.545643+0000","last_became_peered":"2024-09-16T07:38:56.545643+0000","last_unstale":"2024-09-16T07:52:49.611132+0000","last_undegraded":"2024-09-16T07:52:49.611132+0000","last_fullsized":"2024-09-16T07:52:49.611132+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.8","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.609807+0000","last_change":"2024-09-16T07:38:56.657793+0000","last_active":"2024-09-16T07:52:49.609807+0000","last_peered":"2024-09-16T07:52:49.609807+0000","last_clean":"2024-09-16T07:52:49.609807+0000","last_became_active":"2024-09-16T07:38:56.651984+0000","last_became_peered":"2024-09-16T07:38:56.651984+0000","last_unstale":"2024-09-16T07:52:49.609807+0000","last_undegraded":"2024-09-16T07:52:49.609807+0000","last_fullsized":"2024-09-16T07:52:49.609807+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.7","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.601048+0000","last_change":"2024-09-16T07:38:56.624485+0000","last_active":"2024-09-16T07:52:49.601048+0000","last_peered":"2024-09-16T07:52:49.601048+0000","last_clean":"2024-09-16T07:52:49.601048+0000","last_became_active":"2024-09-16T07:38:56.616849+0000","last_became_peered":"2024-09-16T07:38:56.616849+0000","last_unstale":"2024-09-16T07:52:49.601048+0000","last_undegraded":"2024-09-16T07:52:49.601048+0000","last_fullsized":"2024-09-16T07:52:49.601048+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.6","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.644671+0000","last_change":"2024-09-16T07:38:56.531334+0000","last_active":"2024-09-16T07:52:49.644671+0000","last_peered":"2024-09-16T07:52:49.644671+0000","last_clean":"2024-09-16T07:52:49.644671+0000","last_became_active":"2024-09-16T07:38:56.520779+0000","last_became_peered":"2024-09-16T07:38:56.520779+0000","last_unstale":"2024-09-16T07:52:49.644671+0000","last_undegraded":"2024-09-16T07:52:49.644671+0000","last_fullsized":"2024-09-16T07:52:49.644671+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.5","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.600706+0000","last_change":"2024-09-16T07:38:56.590139+0000","last_active":"2024-09-16T07:52:49.600706+0000","last_peered":"2024-09-16T07:52:49.600706+0000","last_clean":"2024-09-16T07:52:49.600706+0000","last_became_active":"2024-09-16T07:38:56.578614+0000","last_became_peered":"2024-09-16T07:38:56.578614+0000","last_unstale":"2024-09-16T07:52:49.600706+0000","last_undegraded":"2024-09-16T07:52:49.600706+0000","last_fullsized":"2024-09-16T07:52:49.600706+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.4","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.628056+0000","last_change":"2024-09-16T07:38:56.684296+0000","last_active":"2024-09-16T07:52:49.628056+0000","last_peered":"2024-09-16T07:52:49.628056+0000","last_clean":"2024-09-16T07:52:49.628056+0000","last_became_active":"2024-09-16T07:38:56.678986+0000","last_became_peered":"2024-09-16T07:38:56.678986+0000","last_unstale":"2024-09-16T07:52:49.628056+0000","last_undegraded":"2024-09-16T07:52:49.628056+0000","last_fullsized":"2024-09-16T07:52:49.628056+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.3","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.623271+0000","last_change":"2024-09-16T07:38:56.574269+0000","last_active":"2024-09-16T07:52:49.623271+0000","last_peered":"2024-09-16T07:52:49.623271+0000","last_clean":"2024-09-16T07:52:49.623271+0000","last_became_active":"2024-09-16T07:38:56.558143+0000","last_became_peered":"2024-09-16T07:38:56.558143+0000","last_unstale":"2024-09-16T07:52:49.623271+0000","last_undegraded":"2024-09-16T07:52:49.623271+0000","last_fullsized":"2024-09-16T07:52:49.623271+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.2","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.611405+0000","last_change":"2024-09-16T07:38:56.563501+0000","last_active":"2024-09-16T07:52:49.611405+0000","last_peered":"2024-09-16T07:52:49.611405+0000","last_clean":"2024-09-16T07:52:49.611405+0000","last_became_active":"2024-09-16T07:38:56.539784+0000","last_became_peered":"2024-09-16T07:38:56.539784+0000","last_unstale":"2024-09-16T07:52:49.611405+0000","last_undegraded":"2024-09-16T07:52:49.611405+0000","last_fullsized":"2024-09-16T07:52:49.611405+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1","version":"239'7","reported_seq":1470,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.607080+0000","last_change":"2024-09-16T07:38:56.532354+0000","last_active":"2024-09-16T07:52:49.607080+0000","last_peered":"2024-09-16T07:52:49.607080+0000","last_clean":"2024-09-16T07:52:49.607080+0000","last_became_active":"2024-09-16T07:38:56.517409+0000","last_became_peered":"2024-09-16T07:38:56.517409+0000","last_unstale":"2024-09-16T07:52:49.607080+0000","last_undegraded":"2024-09-16T07:52:49.607080+0000","last_fullsized":"2024-09-16T07:52:49.607080+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.0","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.613719+0000","last_change":"2024-09-16T07:38:56.506449+0000","last_active":"2024-09-16T07:52:49.613719+0000","last_peered":"2024-09-16T07:52:49.613719+0000","last_clean":"2024-09-16T07:52:49.613719+0000","last_became_active":"2024-09-16T07:38:56.499378+0000","last_became_peered":"2024-09-16T07:38:56.499378+0000","last_unstale":"2024-09-16T07:52:49.613719+0000","last_undegraded":"2024-09-16T07:52:49.613719+0000","last_fullsized":"2024-09-16T07:52:49.613719+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":2136,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.598810+0000","last_change":"2024-09-16T07:33:55.962652+0000","last_active":"2024-09-16T07:52:49.598810+0000","last_peered":"2024-09-16T07:52:49.598810+0000","last_clean":"2024-09-16T07:52:49.598810+0000","last_became_active":"2024-09-16T07:33:53.988604+0000","last_became_peered":"2024-09-16T07:33:53.988604+0000","last_unstale":"2024-09-16T07:52:49.598810+0000","last_undegraded":"2024-09-16T07:52:49.598810+0000","last_fullsized":"2024-09-16T07:52:49.598810+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_clean_scrub_stamp":"2024-09-16T07:33:52.925999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":2136,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.609334+0000","last_change":"2024-09-16T07:33:55.963562+0000","last_active":"2024-09-16T07:52:49.609334+0000","last_peered":"2024-09-16T07:52:49.609334+0000","last_clean":"2024-09-16T07:52:49.609334+0000","last_became_active":"2024-09-16T07:33:53.999244+0000","last_became_peered":"2024-09-16T07:33:53.999244+0000","last_unstale":"2024-09-16T07:52:49.609334+0000","last_undegraded":"2024-09-16T07:52:49.609334+0000","last_fullsized":"2024-09-16T07:52:49.609334+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_clean_scrub_stamp":"2024-09-16T07:33:52.925999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":2136,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.602588+0000","last_change":"2024-09-16T07:33:55.964565+0000","last_active":"2024-09-16T07:52:49.602588+0000","last_peered":"2024-09-16T07:52:49.602588+0000","last_clean":"2024-09-16T07:52:49.602588+0000","last_became_active":"2024-09-16T07:33:54.001528+0000","last_became_peered":"2024-09-16T07:33:54.001528+0000","last_unstale":"2024-09-16T07:52:49.602588+0000","last_undegraded":"2024-09-16T07:52:49.602588+0000","last_fullsized":"2024-09-16T07:52:49.602588+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_clean_scrub_stamp":"2024-09-16T07:33:52.925999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":2136,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.600990+0000","last_change":"2024-09-16T07:33:55.961854+0000","last_active":"2024-09-16T07:52:49.600990+0000","last_peered":"2024-09-16T07:52:49.600990+0000","last_clean":"2024-09-16T07:52:49.600990+0000","last_became_active":"2024-09-16T07:33:53.989047+0000","last_became_peered":"2024-09-16T07:33:53.989047+0000","last_unstale":"2024-09-16T07:52:49.600990+0000","last_undegraded":"2024-09-16T07:52:49.600990+0000","last_fullsized":"2024-09-16T07:52:49.600990+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_clean_scrub_stamp":"2024-09-16T07:33:52.925999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":2138,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.639851+0000","last_change":"2024-09-16T07:33:55.962135+0000","last_active":"2024-09-16T07:52:49.639851+0000","last_peered":"2024-09-16T07:52:49.639851+0000","last_clean":"2024-09-16T07:52:49.639851+0000","last_became_active":"2024-09-16T07:33:53.989661+0000","last_became_peered":"2024-09-16T07:33:53.989661+0000","last_unstale":"2024-09-16T07:52:49.639851+0000","last_undegraded":"2024-09-16T07:52:49.639851+0000","last_fullsized":"2024-09-16T07:52:49.639851+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_clean_scrub_stamp":"2024-09-16T07:33:52.925999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":2136,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.592683+0000","last_change":"2024-09-16T07:33:55.962959+0000","last_active":"2024-09-16T07:52:49.592683+0000","last_peered":"2024-09-16T07:52:49.592683+0000","last_clean":"2024-09-16T07:52:49.592683+0000","last_became_active":"2024-09-16T07:33:54.001165+0000","last_became_peered":"2024-09-16T07:33:54.001165+0000","last_unstale":"2024-09-16T07:52:49.592683+0000","last_undegraded":"2024-09-16T07:52:49.592683+0000","last_fullsized":"2024-09-16T07:52:49.592683+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_clean_scrub_stamp":"2024-09-16T07:33:52.925999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":2136,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.611341+0000","last_change":"2024-09-16T07:33:55.962311+0000","last_active":"2024-09-16T07:52:49.611341+0000","last_peered":"2024-09-16T07:52:49.611341+0000","last_clean":"2024-09-16T07:52:49.611341+0000","last_became_active":"2024-09-16T07:33:53.998493+0000","last_became_peered":"2024-09-16T07:33:53.998493+0000","last_unstale":"2024-09-16T07:52:49.611341+0000","last_undegraded":"2024-09-16T07:52:49.611341+0000","last_fullsized":"2024-09-16T07:52:49.611341+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_clean_scrub_stamp":"2024-09-16T07:33:52.925999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":2137,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.606316+0000","last_change":"2024-09-16T07:33:55.965013+0000","last_active":"2024-09-16T07:52:49.606316+0000","last_peered":"2024-09-16T07:52:49.606316+0000","last_clean":"2024-09-16T07:52:49.606316+0000","last_became_active":"2024-09-16T07:33:54.007370+0000","last_became_peered":"2024-09-16T07:33:54.007370+0000","last_unstale":"2024-09-16T07:52:49.606316+0000","last_undegraded":"2024-09-16T07:52:49.606316+0000","last_fullsized":"2024-09-16T07:52:49.606316+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_clean_scrub_stamp":"2024-09-16T07:33:52.925999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":2208,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.598687+0000","last_change":"2024-09-16T07:33:51.972549+0000","last_active":"2024-09-16T07:52:49.598687+0000","last_peered":"2024-09-16T07:52:49.598687+0000","last_clean":"2024-09-16T07:52:49.598687+0000","last_became_active":"2024-09-16T07:33:51.963446+0000","last_became_peered":"2024-09-16T07:33:51.963446+0000","last_unstale":"2024-09-16T07:52:49.598687+0000","last_undegraded":"2024-09-16T07:52:49.598687+0000","last_fullsized":"2024-09-16T07:52:49.598687+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:50.923539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:50.923539+0000","last_clean_scrub_stamp":"2024-09-16T07:33:50.923539+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":75,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30044,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":63300,"kb_used_data":1780,"kb_used_omap":0,"kb_used_meta":61504,"kb_avail":94308540,"statfs":{"total":96636764160,"available":96571944960,"internally_reserved":0,"allocated":1822720,"data_stored":1158276,"data_compressed":59484,"data_compressed_allocated":81920,"data_compressed_original":634880,"omap_allocated":0,"internal_metadata":62980096},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":64668,"kb_used_data":1740,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94307172,"statfs":{"total":96636764160,"available":96570544128,"internally_reserved":0,"allocated":1781760,"data_stored":580807,"data_compressed":35328,"data_compressed_allocated":49152,"data_compressed_original":73728,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59084,"kb_used_data":1724,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94312756,"statfs":{"total":96636764160,"available":96576262144,"internally_reserved":0,"allocated":1765376,"data_stored":567913,"data_compressed":29440,"data_compressed_allocated":40960,"data_compressed_original":61440,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":68884,"kb_used_data":1796,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94302956,"statfs":{"total":96636764160,"available":96566226944,"internally_reserved":0,"allocated":1839104,"data_stored":1171170,"data_compressed":65372,"data_compressed_allocated":90112,"data_compressed_original":647168,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30044,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:52:52.204 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:52:52.312 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.309+0000 7f3f95191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:52.312 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.314+0000 7f3f95191640 1 Processor -- start 2024-09-16T07:52:52.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.314+0000 7f3f95191640 1 -- start start 2024-09-16T07:52:52.315 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.315+0000 7f3f95191640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f3f90138fd0 0x7f3f9013b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:52:52.315 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.315+0000 7f3f95191640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f90136c10 con 0x7f3f901360f0 2024-09-16T07:52:52.315 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.315+0000 7f3f95191640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f3f900a6010 con 0x7f3f90138fd0 2024-09-16T07:52:52.315 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.315+0000 7f3f87fff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f3f90138fd0 0x7f3f9013b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:52:52.315 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.315+0000 7f3f8ed9d640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f3f901360f0 0x7f3f90136500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:53376/0 (socket says 172.21.15.121:53376) 2024-09-16T07:52:52.315 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.315+0000 7f3f87fff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f3f90138fd0 0x7f3f9013b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:45610/0 (socket says 172.21.15.121:45610) 2024-09-16T07:52:52.315 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.315+0000 7f3f8ed9d640 1 -- 172.21.15.121:0/1497962988 learned_addr learned my addr 172.21.15.121:0/1497962988 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-16T07:52:52.315 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.315+0000 7f3f87fff640 1 -- 172.21.15.121:0/1497962988 >> v1:172.21.15.121:6789/0 conn(0x7f3f901360f0 legacy=0x7f3f90136500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:52:52.315 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.315+0000 7f3f87fff640 1 -- 172.21.15.121:0/1497962988 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f900a5c40 con 0x7f3f90138fd0 2024-09-16T07:52:52.315 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.315+0000 7f3f8e59c640 1 -- 172.21.15.121:0/1497962988 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1292974610 0 0) 0x7f3f80001110 con 0x7f3f901360f0 2024-09-16T07:52:52.315 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.316+0000 7f3f87fff640 1 --2- 172.21.15.121:0/1497962988 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3f90138fd0 0x7f3f9013b3f0 crc :-1 s=READY pgs=13002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a363add13ce223 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:52:52.315 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.316+0000 7f3f8e59c640 1 -- 172.21.15.121:0/1497962988 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3f78009d90 con 0x7f3f90138fd0 2024-09-16T07:52:52.316 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.316+0000 7f3f8e59c640 1 -- 172.21.15.121:0/1497962988 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f3f7800e230 con 0x7f3f90138fd0 2024-09-16T07:52:52.316 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.316+0000 7f3f8e59c640 1 -- 172.21.15.121:0/1497962988 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3f7800e4d0 con 0x7f3f90138fd0 2024-09-16T07:52:52.316 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.316+0000 7f3f95191640 1 -- 172.21.15.121:0/1497962988 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3f90138fd0 msgr2=0x7f3f9013b3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:52:52.317 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.317+0000 7f3f95191640 1 --2- 172.21.15.121:0/1497962988 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3f90138fd0 0x7f3f9013b3f0 crc :-1 s=READY pgs=13002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:52.317 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.317+0000 7f3f95191640 1 -- 172.21.15.121:0/1497962988 shutdown_connections 2024-09-16T07:52:52.317 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.317+0000 7f3f95191640 1 --2- 172.21.15.121:0/1497962988 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3f90138fd0 0x7f3f9013b3f0 unknown :-1 s=CLOSED pgs=13002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:52.317 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.317+0000 7f3f95191640 1 -- 172.21.15.121:0/1497962988 >> 172.21.15.121:0/1497962988 conn(0x7f3f9006f850 msgr2=0x7f3f9009ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:52:52.317 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.317+0000 7f3f95191640 1 -- 172.21.15.121:0/1497962988 shutdown_connections 2024-09-16T07:52:52.317 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.317+0000 7f3f95191640 1 -- 172.21.15.121:0/1497962988 wait complete. 2024-09-16T07:52:52.317 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.317+0000 7f3f95191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:52.318 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.318+0000 7f3f95191640 1 Processor -- start 2024-09-16T07:52:52.318 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.318+0000 7f3f95191640 1 -- start start 2024-09-16T07:52:52.319 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.319+0000 7f3f95191640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3f901360f0 0x7f3f90134800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:52:52.319 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.319+0000 7f3f95191640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3f90121bc0 con 0x7f3f901360f0 2024-09-16T07:52:52.319 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.319+0000 7f3f8ed9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3f901360f0 0x7f3f90134800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:52:52.319 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.319+0000 7f3f8ed9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3f901360f0 0x7f3f90134800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:45612/0 (socket says 172.21.15.121:45612) 2024-09-16T07:52:52.319 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.320+0000 7f3f8ed9d640 1 -- 172.21.15.121:0/871766867 learned_addr learned my addr 172.21.15.121:0/871766867 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:52:52.319 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.320+0000 7f3f8ed9d640 1 -- 172.21.15.121:0/871766867 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f90134e90 con 0x7f3f901360f0 2024-09-16T07:52:52.319 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.320+0000 7f3f8ed9d640 1 --2- 172.21.15.121:0/871766867 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3f901360f0 0x7f3f90134800 crc :-1 s=READY pgs=13003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:52:52.319 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.320+0000 7f3f877fe640 1 -- 172.21.15.121:0/871766867 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3f80004b80 con 0x7f3f901360f0 2024-09-16T07:52:52.319 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.320+0000 7f3f877fe640 1 -- 172.21.15.121:0/871766867 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f3f80004ce0 con 0x7f3f901360f0 2024-09-16T07:52:52.320 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.320+0000 7f3f95191640 1 -- 172.21.15.121:0/871766867 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f901247e0 con 0x7f3f901360f0 2024-09-16T07:52:52.320 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.320+0000 7f3f877fe640 1 -- 172.21.15.121:0/871766867 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3f80007120 con 0x7f3f901360f0 2024-09-16T07:52:52.320 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.320+0000 7f3f95191640 1 -- 172.21.15.121:0/871766867 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f90123c90 con 0x7f3f901360f0 2024-09-16T07:52:52.320 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.321+0000 7f3f95191640 1 -- 172.21.15.121:0/871766867 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f900a10f0 con 0x7f3f901360f0 2024-09-16T07:52:52.321 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.321+0000 7f3f877fe640 1 -- 172.21.15.121:0/871766867 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f3f800072d0 con 0x7f3f901360f0 2024-09-16T07:52:52.321 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.321+0000 7f3f877fe640 1 --2- 172.21.15.121:0/871766867 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f3f7003e930 0x7f3f70040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:52:52.321 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.321+0000 7f3f877fe640 1 -- 172.21.15.121:0/871766867 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(723..723 src has 620..723) ==== 3431+0+0 (crc 0 0 0) 0x7f3f8004f9c0 con 0x7f3f901360f0 2024-09-16T07:52:52.321 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.322+0000 7f3f87fff640 1 --2- 172.21.15.121:0/871766867 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f3f7003e930 0x7f3f70040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:52:52.321 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.322+0000 7f3f87fff640 1 --2- 172.21.15.121:0/871766867 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f3f7003e930 0x7f3f70040e40 crc :-1 s=READY pgs=3847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:52:52.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.327+0000 7f3f877fe640 1 -- 172.21.15.121:0/871766867 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f3f8000a890 con 0x7f3f901360f0 2024-09-16T07:52:52.502 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.503+0000 7f3f95191640 1 -- 172.21.15.121:0/871766867 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3f9009f5a0 con 0x7f3f901360f0 2024-09-16T07:52:52.502 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.504+0000 7f3f877fe640 1 -- 172.21.15.121:0/871766867 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v723) ==== 74+0+11295 (crc 0 0 0) 0x7f3f8000a890 con 0x7f3f901360f0 2024-09-16T07:52:52.503 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:52:52.503 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":723,"fsid":"5b0c4070-0374-47d9-9f2a-f525ac27c89c","created":"2024-09-16T07:33:42.277188+0000","modified":"2024-09-16T07:52:50.573270+0000","last_up_change":"2024-09-16T07:33:49.860289+0000","last_in_change":"2024-09-16T07:33:44.410434+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":200,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:33:50.873314+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-16T07:33:52.616613+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":75,"pool_name":"ceph_test_rados_api_asio","create_time":"2024-09-16T07:38:54.492452+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"240","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ff74ae4d-122c-4c59-9a69-b559f9f27a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":710,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3193900849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6807","nonce":3193900849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":3193900849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6803","nonce":3193900849}]},"public_addr":"172.21.15.121:6808/3193900849","cluster_addr":"172.21.15.121:6807/3193900849","heartbeat_back_addr":"172.21.15.121:6804/3193900849","heartbeat_front_addr":"172.21.15.121:6803/3193900849","state":["exists","up"]},{"osd":1,"uuid":"0d1cdc37-865f-43c6-af56-0ca5fb928e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":710,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6801","nonce":4208564222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":4208564222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":4208564222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6805","nonce":4208564222}]},"public_addr":"172.21.15.121:6801/4208564222","cluster_addr":"172.21.15.121:6800/4208564222","heartbeat_back_addr":"172.21.15.121:6802/4208564222","heartbeat_front_addr":"172.21.15.121:6805/4208564222","state":["exists","up"]},{"osd":2,"uuid":"429c0781-5021-41da-8e0e-985110dcea52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":710,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2274906412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6803","nonce":2274906412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2274906412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2274906412}]},"public_addr":"172.21.15.172:6804/2274906412","cluster_addr":"172.21.15.172:6803/2274906412","heartbeat_back_addr":"172.21.15.172:6813/2274906412","heartbeat_front_addr":"172.21.15.172:6814/2274906412","state":["exists","up"]},{"osd":3,"uuid":"0ea1bce1-3795-403b-af2f-e62972443062","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":710,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3418488586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6807","nonce":3418488586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3418488586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3418488586}]},"public_addr":"172.21.15.172:6808/3418488586","cluster_addr":"172.21.15.172:6807/3418488586","heartbeat_back_addr":"172.21.15.172:6805/3418488586","heartbeat_front_addr":"172.21.15.172:6806/3418488586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]},{"pool":100,"snaps":[{"begin":1,"length":4}]},{"pool":101,"snaps":[{"begin":2,"length":4},{"begin":7,"length":2}]},{"pool":102,"snaps":[{"begin":1,"length":6}]},{"pool":103,"snaps":[{"begin":2,"length":9},{"begin":14,"length":1}]},{"pool":104,"snaps":[{"begin":2,"length":1}]},{"pool":179,"snaps":[{"begin":1,"length":1}]},{"pool":180,"snaps":[{"begin":1,"length":1}]},{"pool":182,"snaps":[{"begin":1,"length":1}]},{"pool":183,"snaps":[{"begin":1,"length":2}]},{"pool":184,"snaps":[{"begin":3,"length":1}]},{"pool":187,"snaps":[{"begin":2,"length":2}]},{"pool":189,"snaps":[{"begin":3,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:52:52.505 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.506+0000 7f3f95191640 1 -- 172.21.15.121:0/871766867 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f3f7003e930 msgr2=0x7f3f70040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:52:52.505 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.506+0000 7f3f95191640 1 --2- 172.21.15.121:0/871766867 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f3f7003e930 0x7f3f70040e40 crc :-1 s=READY pgs=3847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:52.505 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.506+0000 7f3f95191640 1 -- 172.21.15.121:0/871766867 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3f901360f0 msgr2=0x7f3f90134800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:52:52.505 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.506+0000 7f3f95191640 1 --2- 172.21.15.121:0/871766867 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3f901360f0 0x7f3f90134800 crc :-1 s=READY pgs=13003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:52.505 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.506+0000 7f3f95191640 1 -- 172.21.15.121:0/871766867 shutdown_connections 2024-09-16T07:52:52.505 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.506+0000 7f3f95191640 1 --2- 172.21.15.121:0/871766867 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f3f7003e930 0x7f3f70040e40 unknown :-1 s=CLOSED pgs=3847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:52.505 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.506+0000 7f3f95191640 1 --2- 172.21.15.121:0/871766867 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3f901360f0 0x7f3f90134800 unknown :-1 s=CLOSED pgs=13003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:52.506 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.506+0000 7f3f95191640 1 -- 172.21.15.121:0/871766867 >> 172.21.15.121:0/871766867 conn(0x7f3f9006f850 msgr2=0x7f3f901be0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:52:52.506 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.506+0000 7f3f95191640 1 -- 172.21.15.121:0/871766867 shutdown_connections 2024-09-16T07:52:52.506 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:52.506+0000 7f3f95191640 1 -- 172.21.15.121:0/871766867 wait complete. 2024-09-16T07:52:53.518 INFO:tasks.ceph:Scrubbing osd.0 2024-09-16T07:52:53.518 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-16T07:52:53.637 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.630+0000 7f7110911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:53.638 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.639+0000 7f7110911640 1 Processor -- start 2024-09-16T07:52:53.638 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.639+0000 7f7110911640 1 -- start start 2024-09-16T07:52:53.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.641+0000 7f7110911640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f710c09b7f0 0x7f710c09bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:52:53.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.641+0000 7f7110911640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f710c075120 con 0x7f710c09c140 2024-09-16T07:52:53.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.641+0000 7f7110911640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f710c09d620 con 0x7f710c09b7f0 2024-09-16T07:52:53.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.641+0000 7f710a59c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f710c09b7f0 0x7f710c09bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:52:53.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.641+0000 7f710a59c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f710c09b7f0 0x7f710c09bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:45618/0 (socket says 172.21.15.121:45618) 2024-09-16T07:52:53.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.641+0000 7f710a59c640 1 -- 172.21.15.121:0/1192575087 learned_addr learned my addr 172.21.15.121:0/1192575087 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:52:53.641 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.641+0000 7f7109d9b640 1 --1- 172.21.15.121:0/1192575087 >> v1:172.21.15.121:6789/0 conn(0x7f710c09c140 0x7f710c09a0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:53382/0 (socket says 172.21.15.121:53382) 2024-09-16T07:52:53.641 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.641+0000 7f710a59c640 1 -- 172.21.15.121:0/1192575087 >> v1:172.21.15.121:6789/0 conn(0x7f710c09c140 legacy=0x7f710c09a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:52:53.641 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.641+0000 7f710a59c640 1 -- 172.21.15.121:0/1192575087 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f710c09cb10 con 0x7f710c09b7f0 2024-09-16T07:52:53.641 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.641+0000 7f710959a640 1 -- 172.21.15.121:0/1192575087 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2723157813 0 0) 0x7f710c075120 con 0x7f710c09c140 2024-09-16T07:52:53.641 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.641+0000 7f710a59c640 1 --2- 172.21.15.121:0/1192575087 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f710c09b7f0 0x7f710c09bc00 crc :-1 s=READY pgs=13005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef0fc6b52d41d6ac server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:52:53.641 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.641+0000 7f710959a640 1 -- 172.21.15.121:0/1192575087 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f70fc00e040 con 0x7f710c09b7f0 2024-09-16T07:52:53.641 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.641+0000 7f710959a640 1 -- 172.21.15.121:0/1192575087 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f70fc0091e0 con 0x7f710c09b7f0 2024-09-16T07:52:53.641 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.641+0000 7f710959a640 1 -- 172.21.15.121:0/1192575087 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f70fc007730 con 0x7f710c09b7f0 2024-09-16T07:52:53.642 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.642+0000 7f7110911640 1 -- 172.21.15.121:0/1192575087 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f710c09b7f0 msgr2=0x7f710c09bc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:52:53.642 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.642+0000 7f7110911640 1 --2- 172.21.15.121:0/1192575087 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f710c09b7f0 0x7f710c09bc00 crc :-1 s=READY pgs=13005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:53.642 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.642+0000 7f7110911640 1 -- 172.21.15.121:0/1192575087 shutdown_connections 2024-09-16T07:52:53.642 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.642+0000 7f7110911640 1 --2- 172.21.15.121:0/1192575087 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f710c09b7f0 0x7f710c09bc00 unknown :-1 s=CLOSED pgs=13005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:53.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.642+0000 7f7110911640 1 -- 172.21.15.121:0/1192575087 >> 172.21.15.121:0/1192575087 conn(0x7f710c0a1580 msgr2=0x7f710c09ecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:52:53.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.642+0000 7f7110911640 1 -- 172.21.15.121:0/1192575087 shutdown_connections 2024-09-16T07:52:53.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.642+0000 7f7110911640 1 -- 172.21.15.121:0/1192575087 wait complete. 2024-09-16T07:52:53.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.642+0000 7f7110911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:53.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.644+0000 7f7110911640 1 Processor -- start 2024-09-16T07:52:53.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.644+0000 7f7110911640 1 -- start start 2024-09-16T07:52:53.645 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.645+0000 7f7110911640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f710c09b7f0 0x7f710c12bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:52:53.645 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.645+0000 7f7110911640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f710c130b30 con 0x7f710c09b7f0 2024-09-16T07:52:53.645 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.645+0000 7f710a59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f710c09b7f0 0x7f710c12bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:52:53.645 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.645+0000 7f710a59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f710c09b7f0 0x7f710c12bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:45628/0 (socket says 172.21.15.121:45628) 2024-09-16T07:52:53.645 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.645+0000 7f710a59c640 1 -- 172.21.15.121:0/2815273635 learned_addr learned my addr 172.21.15.121:0/2815273635 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:52:53.645 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.645+0000 7f710a59c640 1 -- 172.21.15.121:0/2815273635 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f710c12b4c0 con 0x7f710c09b7f0 2024-09-16T07:52:53.645 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.646+0000 7f710a59c640 1 --2- 172.21.15.121:0/2815273635 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f710c09b7f0 0x7f710c12bf00 crc :-1 s=READY pgs=13006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:52:53.645 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.646+0000 7f70faffd640 1 -- 172.21.15.121:0/2815273635 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f70fc00e040 con 0x7f710c09b7f0 2024-09-16T07:52:53.645 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.646+0000 7f70faffd640 1 -- 172.21.15.121:0/2815273635 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f70fc010800 con 0x7f710c09b7f0 2024-09-16T07:52:53.645 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.646+0000 7f70faffd640 1 -- 172.21.15.121:0/2815273635 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f70fc010aa0 con 0x7f710c09b7f0 2024-09-16T07:52:53.646 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.646+0000 7f7110911640 1 -- 172.21.15.121:0/2815273635 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f710c12c440 con 0x7f710c09b7f0 2024-09-16T07:52:53.646 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.646+0000 7f7110911640 1 -- 172.21.15.121:0/2815273635 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f710c09e280 con 0x7f710c09b7f0 2024-09-16T07:52:53.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.647+0000 7f7110911640 1 -- 172.21.15.121:0/2815273635 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f710c0a2c60 con 0x7f710c09b7f0 2024-09-16T07:52:53.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.647+0000 7f70faffd640 1 -- 172.21.15.121:0/2815273635 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f70fc010c00 con 0x7f710c09b7f0 2024-09-16T07:52:53.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.647+0000 7f70faffd640 1 --2- 172.21.15.121:0/2815273635 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f70ec03e930 0x7f70ec040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:52:53.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.647+0000 7f70faffd640 1 -- 172.21.15.121:0/2815273635 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(723..723 src has 620..723) ==== 3431+0+0 (crc 0 0 0) 0x7f70fc050f60 con 0x7f710c09b7f0 2024-09-16T07:52:53.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.647+0000 7f70faffd640 1 --2- 172.21.15.121:0/2815273635 >> v2:172.21.15.121:6808/3193900849 conn(0x7f70ec044a70 0x7f70ec046f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:52:53.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.647+0000 7f70faffd640 1 -- 172.21.15.121:0/2815273635 --> v2:172.21.15.121:6808/3193900849 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f70ec0475f0 con 0x7f70ec044a70 2024-09-16T07:52:53.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.647+0000 7f70faffd640 1 -- 172.21.15.121:0/2815273635 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_get_version_reply(handle=1 version=723) ==== 24+0+0 (crc 0 0 0) 0x7f70fc053450 con 0x7f710c09b7f0 2024-09-16T07:52:53.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.648+0000 7f7109d9b640 1 --2- 172.21.15.121:0/2815273635 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f70ec03e930 0x7f70ec040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:52:53.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.648+0000 7f7109d9b640 1 --2- 172.21.15.121:0/2815273635 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f70ec03e930 0x7f70ec040e40 crc :-1 s=READY pgs=3848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:52:53.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.648+0000 7f710ad9d640 1 --2- 172.21.15.121:0/2815273635 >> v2:172.21.15.121:6808/3193900849 conn(0x7f70ec044a70 0x7f70ec046f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T07:52:53.650 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.652+0000 7f710ad9d640 1 --2- 172.21.15.121:0/2815273635 >> v2:172.21.15.121:6808/3193900849 conn(0x7f70ec044a70 0x7f70ec046f60 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:52:53.652 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.653+0000 7f70faffd640 1 -- 172.21.15.121:0/2815273635 <== osd.0 v2:172.21.15.121:6808/3193900849 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5790 (crc 0 0 0) 0x7f70ec0475f0 con 0x7f70ec044a70 2024-09-16T07:52:53.655 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.656+0000 7f7110911640 1 -- 172.21.15.121:0/2815273635 --> v2:172.21.15.121:6808/3193900849 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f710c06f440 con 0x7f70ec044a70 2024-09-16T07:52:53.657 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.658+0000 7f70faffd640 1 -- 172.21.15.121:0/2815273635 <== osd.0 v2:172.21.15.121:6808/3193900849 2 ==== command_reply(tid 2: 0 ) ==== 8+0+22 (crc 0 0 0) 0x7f7104009830 con 0x7f70ec044a70 2024-09-16T07:52:53.657 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-16T07:52:53.657 INFO:teuthology.orchestra.run.smithi121.stdout: "success": "" 2024-09-16T07:52:53.657 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-16T07:52:53.658 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.658+0000 7f7110911640 1 -- 172.21.15.121:0/2815273635 >> v2:172.21.15.121:6808/3193900849 conn(0x7f70ec044a70 msgr2=0x7f70ec046f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:52:53.658 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.658+0000 7f7110911640 1 --2- 172.21.15.121:0/2815273635 >> v2:172.21.15.121:6808/3193900849 conn(0x7f70ec044a70 0x7f70ec046f60 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:53.658 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.658+0000 7f7110911640 1 -- 172.21.15.121:0/2815273635 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f70ec03e930 msgr2=0x7f70ec040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:52:53.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.658+0000 7f7110911640 1 --2- 172.21.15.121:0/2815273635 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f70ec03e930 0x7f70ec040e40 crc :-1 s=READY pgs=3848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:53.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.658+0000 7f7110911640 1 -- 172.21.15.121:0/2815273635 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f710c09b7f0 msgr2=0x7f710c12bf00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:52:53.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.658+0000 7f7110911640 1 --2- 172.21.15.121:0/2815273635 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f710c09b7f0 0x7f710c12bf00 crc :-1 s=READY pgs=13006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:53.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.659+0000 7f7110911640 1 -- 172.21.15.121:0/2815273635 shutdown_connections 2024-09-16T07:52:53.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.659+0000 7f7110911640 1 --2- 172.21.15.121:0/2815273635 >> v2:172.21.15.121:6808/3193900849 conn(0x7f70ec044a70 0x7f70ec046f60 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:53.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.659+0000 7f7110911640 1 --2- 172.21.15.121:0/2815273635 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f70ec03e930 0x7f70ec040e40 unknown :-1 s=CLOSED pgs=3848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:53.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.659+0000 7f7110911640 1 --2- 172.21.15.121:0/2815273635 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f710c09b7f0 0x7f710c12bf00 unknown :-1 s=CLOSED pgs=13006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:53.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.659+0000 7f7110911640 1 -- 172.21.15.121:0/2815273635 >> 172.21.15.121:0/2815273635 conn(0x7f710c0a1580 msgr2=0x7f710c137020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:52:53.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.659+0000 7f7110911640 1 -- 172.21.15.121:0/2815273635 shutdown_connections 2024-09-16T07:52:53.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.659+0000 7f7110911640 1 -- 172.21.15.121:0/2815273635 wait complete. 2024-09-16T07:52:53.669 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-16T07:52:53.777 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.773+0000 7f4d4d551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:53.778 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.779+0000 7f4d4d551640 1 Processor -- start 2024-09-16T07:52:53.778 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.779+0000 7f4d4d551640 1 -- start start 2024-09-16T07:52:53.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.780+0000 7f4d4d551640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f4d48134770 0x7f4d481391e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:52:53.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.780+0000 7f4d4d551640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d480a2590 con 0x7f4d48133c50 2024-09-16T07:52:53.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.780+0000 7f4d4d551640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f4d480a2c00 con 0x7f4d48134770 2024-09-16T07:52:53.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.780+0000 7f4d3e7fc640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f4d48134770 0x7f4d481391e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:52:53.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.781+0000 7f4d3e7fc640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f4d48134770 0x7f4d481391e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:45644/0 (socket says 172.21.15.121:45644) 2024-09-16T07:52:53.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.781+0000 7f4d3e7fc640 1 -- 172.21.15.121:0/3915695485 learned_addr learned my addr 172.21.15.121:0/3915695485 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:52:53.781 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.781+0000 7f4d46ffd640 1 --1- 172.21.15.121:0/3915695485 >> v1:172.21.15.121:6789/0 conn(0x7f4d48133c50 0x7f4d48134060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:53392/0 (socket says 172.21.15.121:53392) 2024-09-16T07:52:53.781 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.781+0000 7f4d3e7fc640 1 -- 172.21.15.121:0/3915695485 >> v1:172.21.15.121:6789/0 conn(0x7f4d48133c50 legacy=0x7f4d48134060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:52:53.781 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.781+0000 7f4d3e7fc640 1 -- 172.21.15.121:0/3915695485 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d4809dfb0 con 0x7f4d48134770 2024-09-16T07:52:53.781 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.781+0000 7f4d3e7fc640 1 --2- 172.21.15.121:0/3915695485 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4d48134770 0x7f4d481391e0 crc :-1 s=READY pgs=13008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4630396ef78a895 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:52:53.781 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.781+0000 7f4d467fc640 1 -- 172.21.15.121:0/3915695485 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4d30009e50 con 0x7f4d48134770 2024-09-16T07:52:53.781 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.781+0000 7f4d467fc640 1 -- 172.21.15.121:0/3915695485 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4d3000e230 con 0x7f4d48134770 2024-09-16T07:52:53.781 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.781+0000 7f4d467fc640 1 -- 172.21.15.121:0/3915695485 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4d3000e4d0 con 0x7f4d48134770 2024-09-16T07:52:53.782 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.782+0000 7f4d4d551640 1 -- 172.21.15.121:0/3915695485 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4d48134770 msgr2=0x7f4d481391e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:52:53.782 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.782+0000 7f4d4d551640 1 --2- 172.21.15.121:0/3915695485 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4d48134770 0x7f4d481391e0 crc :-1 s=READY pgs=13008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:53.782 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.782+0000 7f4d4d551640 1 -- 172.21.15.121:0/3915695485 shutdown_connections 2024-09-16T07:52:53.782 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.782+0000 7f4d4d551640 1 --2- 172.21.15.121:0/3915695485 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4d48134770 0x7f4d481391e0 unknown :-1 s=CLOSED pgs=13008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:53.782 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.782+0000 7f4d4d551640 1 -- 172.21.15.121:0/3915695485 >> 172.21.15.121:0/3915695485 conn(0x7f4d480a3050 msgr2=0x7f4d480a3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:52:53.782 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.782+0000 7f4d4d551640 1 -- 172.21.15.121:0/3915695485 shutdown_connections 2024-09-16T07:52:53.782 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.782+0000 7f4d4d551640 1 -- 172.21.15.121:0/3915695485 wait complete. 2024-09-16T07:52:53.782 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.782+0000 7f4d4d551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:53.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.784+0000 7f4d4d551640 1 Processor -- start 2024-09-16T07:52:53.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.784+0000 7f4d4d551640 1 -- start start 2024-09-16T07:52:53.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.785+0000 7f4d4d551640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4d48133c50 0x7f4d4806e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:52:53.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.785+0000 7f4d4d551640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4d481249c0 con 0x7f4d48133c50 2024-09-16T07:52:53.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.785+0000 7f4d46ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4d48133c50 0x7f4d4806e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:52:53.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.785+0000 7f4d46ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4d48133c50 0x7f4d4806e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:45656/0 (socket says 172.21.15.121:45656) 2024-09-16T07:52:53.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.785+0000 7f4d46ffd640 1 -- 172.21.15.121:0/1779439750 learned_addr learned my addr 172.21.15.121:0/1779439750 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:52:53.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.785+0000 7f4d46ffd640 1 -- 172.21.15.121:0/1779439750 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d4806fbf0 con 0x7f4d48133c50 2024-09-16T07:52:53.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.785+0000 7f4d46ffd640 1 --2- 172.21.15.121:0/1779439750 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4d48133c50 0x7f4d4806e8d0 crc :-1 s=READY pgs=13009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:52:53.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.785+0000 7f4d3ffff640 1 -- 172.21.15.121:0/1779439750 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4d380059a0 con 0x7f4d48133c50 2024-09-16T07:52:53.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.786+0000 7f4d3ffff640 1 -- 172.21.15.121:0/1779439750 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4d38005b00 con 0x7f4d48133c50 2024-09-16T07:52:53.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.786+0000 7f4d4d551640 1 -- 172.21.15.121:0/1779439750 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d48070270 con 0x7f4d48133c50 2024-09-16T07:52:53.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.786+0000 7f4d3ffff640 1 -- 172.21.15.121:0/1779439750 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4d38005da0 con 0x7f4d48133c50 2024-09-16T07:52:53.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.786+0000 7f4d4d551640 1 -- 172.21.15.121:0/1779439750 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d48123390 con 0x7f4d48133c50 2024-09-16T07:52:53.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.787+0000 7f4d4d551640 1 -- 172.21.15.121:0/1779439750 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d48134060 con 0x7f4d48133c50 2024-09-16T07:52:53.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.787+0000 7f4d3ffff640 1 -- 172.21.15.121:0/1779439750 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f4d380070b0 con 0x7f4d48133c50 2024-09-16T07:52:53.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.787+0000 7f4d3ffff640 1 --2- 172.21.15.121:0/1779439750 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f4d2803e930 0x7f4d28040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:52:53.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.787+0000 7f4d3ffff640 1 -- 172.21.15.121:0/1779439750 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(723..723 src has 620..723) ==== 3431+0+0 (crc 0 0 0) 0x7f4d3804fa00 con 0x7f4d48133c50 2024-09-16T07:52:53.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.787+0000 7f4d3e7fc640 1 --2- 172.21.15.121:0/1779439750 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f4d2803e930 0x7f4d28040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:52:53.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.788+0000 7f4d3e7fc640 1 --2- 172.21.15.121:0/1779439750 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f4d2803e930 0x7f4d28040e40 crc :-1 s=READY pgs=3849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:52:53.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.792+0000 7f4d3ffff640 1 -- 172.21.15.121:0/1779439750 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f4d3800f230 con 0x7f4d48133c50 2024-09-16T07:52:53.968 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.969+0000 7f4d4d551640 1 -- 172.21.15.121:0/1779439750 --> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f4d480a28e0 con 0x7f4d2803e930 2024-09-16T07:52:53.969 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.970+0000 7f4d3ffff640 1 -- 172.21.15.121:0/1779439750 <== mgr.4102 v2:172.21.15.172:6800/643901738 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (crc 0 0 0) 0x7f4d480a28e0 con 0x7f4d2803e930 2024-09-16T07:52:53.969 INFO:teuthology.orchestra.run.smithi121.stderr:instructed osd(s) 0 to deep-scrub 2024-09-16T07:52:53.972 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.972+0000 7f4d4d551640 1 -- 172.21.15.121:0/1779439750 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f4d2803e930 msgr2=0x7f4d28040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:52:53.972 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.972+0000 7f4d4d551640 1 --2- 172.21.15.121:0/1779439750 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f4d2803e930 0x7f4d28040e40 crc :-1 s=READY pgs=3849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:53.972 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.973+0000 7f4d4d551640 1 -- 172.21.15.121:0/1779439750 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4d48133c50 msgr2=0x7f4d4806e8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:52:53.972 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.973+0000 7f4d4d551640 1 --2- 172.21.15.121:0/1779439750 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4d48133c50 0x7f4d4806e8d0 crc :-1 s=READY pgs=13009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:53.972 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.973+0000 7f4d4d551640 1 -- 172.21.15.121:0/1779439750 shutdown_connections 2024-09-16T07:52:53.972 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.973+0000 7f4d4d551640 1 --2- 172.21.15.121:0/1779439750 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f4d2803e930 0x7f4d28040e40 unknown :-1 s=CLOSED pgs=3849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:53.972 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.973+0000 7f4d4d551640 1 --2- 172.21.15.121:0/1779439750 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4d48133c50 0x7f4d4806e8d0 unknown :-1 s=CLOSED pgs=13009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:53.972 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.973+0000 7f4d4d551640 1 -- 172.21.15.121:0/1779439750 >> 172.21.15.121:0/1779439750 conn(0x7f4d480a3050 msgr2=0x7f4d480a41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:52:53.972 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.973+0000 7f4d4d551640 1 -- 172.21.15.121:0/1779439750 shutdown_connections 2024-09-16T07:52:53.972 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:53.973+0000 7f4d4d551640 1 -- 172.21.15.121:0/1779439750 wait complete. 2024-09-16T07:52:53.993 INFO:tasks.ceph:Scrubbing osd.1 2024-09-16T07:52:53.994 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-16T07:52:54.108 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.100+0000 7f9ff54d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:54.109 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.110+0000 7f9ff54d1640 1 Processor -- start 2024-09-16T07:52:54.109 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.110+0000 7f9ff54d1640 1 -- start start 2024-09-16T07:52:54.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.112+0000 7f9ff54d1640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f9ff009ef70 0x7f9ff009c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:52:54.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.112+0000 7f9ff54d1640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ff009f380 con 0x7f9ff009cc40 2024-09-16T07:52:54.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.112+0000 7f9ff54d1640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f9ff009e080 con 0x7f9ff009ef70 2024-09-16T07:52:54.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.112+0000 7f9feeffd640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f9ff009ef70 0x7f9ff009c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:52:54.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.112+0000 7f9fee7fc640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f9ff009cc40 0x7f9ff0137370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:53396/0 (socket says 172.21.15.121:53396) 2024-09-16T07:52:54.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.112+0000 7f9feeffd640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f9ff009ef70 0x7f9ff009c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:45672/0 (socket says 172.21.15.121:45672) 2024-09-16T07:52:54.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.112+0000 7f9fee7fc640 1 -- 172.21.15.121:0/2736621143 learned_addr learned my addr 172.21.15.121:0/2736621143 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-16T07:52:54.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.112+0000 7f9feeffd640 1 -- 172.21.15.121:0/2736621143 >> v1:172.21.15.121:6789/0 conn(0x7f9ff009cc40 legacy=0x7f9ff0137370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:52:54.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.112+0000 7f9feeffd640 1 -- 172.21.15.121:0/2736621143 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ff00a5030 con 0x7f9ff009ef70 2024-09-16T07:52:54.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.112+0000 7f9feeffd640 1 --2- 172.21.15.121:0/2736621143 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ff009ef70 0x7f9ff009c700 crc :-1 s=READY pgs=13011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8c2360829cd7733 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:52:54.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.112+0000 7f9fedffb640 1 -- 172.21.15.121:0/2736621143 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9fe000e040 con 0x7f9ff009ef70 2024-09-16T07:52:54.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.112+0000 7f9fedffb640 1 -- 172.21.15.121:0/2736621143 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f9fe0007670 con 0x7f9ff009ef70 2024-09-16T07:52:54.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.113+0000 7f9fedffb640 1 -- 172.21.15.121:0/2736621143 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9fe0007910 con 0x7f9ff009ef70 2024-09-16T07:52:54.113 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.113+0000 7f9ff54d1640 1 -- 172.21.15.121:0/2736621143 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ff009ef70 msgr2=0x7f9ff009c700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:52:54.113 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.113+0000 7f9ff54d1640 1 --2- 172.21.15.121:0/2736621143 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ff009ef70 0x7f9ff009c700 crc :-1 s=READY pgs=13011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:54.113 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.113+0000 7f9ff54d1640 1 -- 172.21.15.121:0/2736621143 shutdown_connections 2024-09-16T07:52:54.113 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.113+0000 7f9ff54d1640 1 --2- 172.21.15.121:0/2736621143 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ff009ef70 0x7f9ff009c700 unknown :-1 s=CLOSED pgs=13011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:54.113 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.113+0000 7f9ff54d1640 1 -- 172.21.15.121:0/2736621143 >> 172.21.15.121:0/2736621143 conn(0x7f9ff00a3100 msgr2=0x7f9ff00a3510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:52:54.113 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.113+0000 7f9ff54d1640 1 -- 172.21.15.121:0/2736621143 shutdown_connections 2024-09-16T07:52:54.113 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.113+0000 7f9ff54d1640 1 -- 172.21.15.121:0/2736621143 wait complete. 2024-09-16T07:52:54.113 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.114+0000 7f9ff54d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:54.114 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.115+0000 7f9ff54d1640 1 Processor -- start 2024-09-16T07:52:54.114 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.115+0000 7f9ff54d1640 1 -- start start 2024-09-16T07:52:54.115 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.116+0000 7f9ff54d1640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ff009cc40 0x7f9ff01b5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:52:54.115 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.116+0000 7f9ff54d1640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff01b9c30 con 0x7f9ff009cc40 2024-09-16T07:52:54.116 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.116+0000 7f9feeffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ff009cc40 0x7f9ff01b5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:52:54.116 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.116+0000 7f9feeffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ff009cc40 0x7f9ff01b5d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:45678/0 (socket says 172.21.15.121:45678) 2024-09-16T07:52:54.116 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.116+0000 7f9feeffd640 1 -- 172.21.15.121:0/414502664 learned_addr learned my addr 172.21.15.121:0/414502664 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:52:54.116 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.116+0000 7f9feeffd640 1 -- 172.21.15.121:0/414502664 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ff01b9070 con 0x7f9ff009cc40 2024-09-16T07:52:54.116 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.117+0000 7f9feeffd640 1 --2- 172.21.15.121:0/414502664 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ff009cc40 0x7f9ff01b5d40 crc :-1 s=READY pgs=13012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:52:54.116 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.117+0000 7f9fd77fe640 1 -- 172.21.15.121:0/414502664 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9fe0017040 con 0x7f9ff009cc40 2024-09-16T07:52:54.116 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.117+0000 7f9ff54d1640 1 -- 172.21.15.121:0/414502664 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ff01b76b0 con 0x7f9ff009cc40 2024-09-16T07:52:54.116 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.117+0000 7f9fd77fe640 1 -- 172.21.15.121:0/414502664 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f9fe0012bb0 con 0x7f9ff009cc40 2024-09-16T07:52:54.116 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.117+0000 7f9fd77fe640 1 -- 172.21.15.121:0/414502664 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9fe000e040 con 0x7f9ff009cc40 2024-09-16T07:52:54.116 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.117+0000 7f9ff54d1640 1 -- 172.21.15.121:0/414502664 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ff01b97c0 con 0x7f9ff009cc40 2024-09-16T07:52:54.117 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.117+0000 7f9ff54d1640 1 -- 172.21.15.121:0/414502664 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9ff01b9e10 con 0x7f9ff009cc40 2024-09-16T07:52:54.117 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.118+0000 7f9fd77fe640 1 -- 172.21.15.121:0/414502664 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f9fe001a040 con 0x7f9ff009cc40 2024-09-16T07:52:54.117 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.118+0000 7f9fd77fe640 1 --2- 172.21.15.121:0/414502664 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f9fdc03e8e0 0x7f9fdc040df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:52:54.117 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.118+0000 7f9fd77fe640 1 -- 172.21.15.121:0/414502664 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(723..723 src has 620..723) ==== 3431+0+0 (crc 0 0 0) 0x7f9fe0052e50 con 0x7f9ff009cc40 2024-09-16T07:52:54.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.118+0000 7f9fd77fe640 1 --2- 172.21.15.121:0/414502664 >> v2:172.21.15.121:6801/4208564222 conn(0x7f9fdc044a20 0x7f9fdc046f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:52:54.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.118+0000 7f9fd77fe640 1 -- 172.21.15.121:0/414502664 --> v2:172.21.15.121:6801/4208564222 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9fdc0475a0 con 0x7f9fdc044a20 2024-09-16T07:52:54.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.118+0000 7f9fd77fe640 1 -- 172.21.15.121:0/414502664 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_get_version_reply(handle=1 version=723) ==== 24+0+0 (crc 0 0 0) 0x7f9fe00553c0 con 0x7f9ff009cc40 2024-09-16T07:52:54.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.118+0000 7f9fee7fc640 1 --2- 172.21.15.121:0/414502664 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f9fdc03e8e0 0x7f9fdc040df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:52:54.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.119+0000 7f9fee7fc640 1 --2- 172.21.15.121:0/414502664 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f9fdc03e8e0 0x7f9fdc040df0 crc :-1 s=READY pgs=3850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:52:54.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.119+0000 7f9fef7fe640 1 --2- 172.21.15.121:0/414502664 >> v2:172.21.15.121:6801/4208564222 conn(0x7f9fdc044a20 0x7f9fdc046f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T07:52:54.121 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.122+0000 7f9fef7fe640 1 --2- 172.21.15.121:0/414502664 >> v2:172.21.15.121:6801/4208564222 conn(0x7f9fdc044a20 0x7f9fdc046f10 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:52:54.123 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.124+0000 7f9fd77fe640 1 -- 172.21.15.121:0/414502664 <== osd.1 v2:172.21.15.121:6801/4208564222 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5790 (crc 0 0 0) 0x7f9fdc0475a0 con 0x7f9fdc044a20 2024-09-16T07:52:54.126 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.128+0000 7f9ff54d1640 1 -- 172.21.15.121:0/414502664 --> v2:172.21.15.121:6801/4208564222 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f9ff009e340 con 0x7f9fdc044a20 2024-09-16T07:52:54.128 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.129+0000 7f9fd77fe640 1 -- 172.21.15.121:0/414502664 <== osd.1 v2:172.21.15.121:6801/4208564222 2 ==== command_reply(tid 2: 0 ) ==== 8+0+22 (crc 0 0 0) 0x7f9fe8009830 con 0x7f9fdc044a20 2024-09-16T07:52:54.128 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-16T07:52:54.128 INFO:teuthology.orchestra.run.smithi121.stdout: "success": "" 2024-09-16T07:52:54.128 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-16T07:52:54.129 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.129+0000 7f9ff54d1640 1 -- 172.21.15.121:0/414502664 >> v2:172.21.15.121:6801/4208564222 conn(0x7f9fdc044a20 msgr2=0x7f9fdc046f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:52:54.129 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.129+0000 7f9ff54d1640 1 --2- 172.21.15.121:0/414502664 >> v2:172.21.15.121:6801/4208564222 conn(0x7f9fdc044a20 0x7f9fdc046f10 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:54.129 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.130+0000 7f9ff54d1640 1 -- 172.21.15.121:0/414502664 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f9fdc03e8e0 msgr2=0x7f9fdc040df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:52:54.130 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.130+0000 7f9ff54d1640 1 --2- 172.21.15.121:0/414502664 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f9fdc03e8e0 0x7f9fdc040df0 crc :-1 s=READY pgs=3850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:54.130 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.130+0000 7f9ff54d1640 1 -- 172.21.15.121:0/414502664 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ff009cc40 msgr2=0x7f9ff01b5d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:52:54.130 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.130+0000 7f9ff54d1640 1 --2- 172.21.15.121:0/414502664 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ff009cc40 0x7f9ff01b5d40 crc :-1 s=READY pgs=13012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:54.130 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.130+0000 7f9ff54d1640 1 -- 172.21.15.121:0/414502664 shutdown_connections 2024-09-16T07:52:54.130 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.130+0000 7f9ff54d1640 1 --2- 172.21.15.121:0/414502664 >> v2:172.21.15.121:6801/4208564222 conn(0x7f9fdc044a20 0x7f9fdc046f10 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:54.130 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.130+0000 7f9ff54d1640 1 --2- 172.21.15.121:0/414502664 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f9fdc03e8e0 0x7f9fdc040df0 unknown :-1 s=CLOSED pgs=3850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:54.130 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.130+0000 7f9ff54d1640 1 --2- 172.21.15.121:0/414502664 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ff009cc40 0x7f9ff01b5d40 unknown :-1 s=CLOSED pgs=13012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:54.130 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.130+0000 7f9ff54d1640 1 -- 172.21.15.121:0/414502664 >> 172.21.15.121:0/414502664 conn(0x7f9ff00a3100 msgr2=0x7f9ff01aefd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:52:54.130 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.130+0000 7f9ff54d1640 1 -- 172.21.15.121:0/414502664 shutdown_connections 2024-09-16T07:52:54.130 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.130+0000 7f9ff54d1640 1 -- 172.21.15.121:0/414502664 wait complete. 2024-09-16T07:52:54.139 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-16T07:52:54.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.244+0000 7f2810b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:54.249 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.250+0000 7f2810b51640 1 Processor -- start 2024-09-16T07:52:54.249 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.250+0000 7f2810b51640 1 -- start start 2024-09-16T07:52:54.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.251+0000 7f2810b51640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f280c09e910 0x7f280c069450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:52:54.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.251+0000 7f2810b51640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f280c06d370 con 0x7f280c09f040 2024-09-16T07:52:54.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.251+0000 7f2810b51640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f280c070cb0 con 0x7f280c09e910 2024-09-16T07:52:54.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.252+0000 7f2809d9b640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f280c09e910 0x7f280c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:52:54.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.252+0000 7f280a59c640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f280c09f040 0x7f280c068d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:49800/0 (socket says 172.21.15.121:49800) 2024-09-16T07:52:54.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.252+0000 7f2809d9b640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f280c09e910 0x7f280c069450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40974/0 (socket says 172.21.15.121:40974) 2024-09-16T07:52:54.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.252+0000 7f280a59c640 1 -- 172.21.15.121:0/4091096702 learned_addr learned my addr 172.21.15.121:0/4091096702 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-16T07:52:54.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.252+0000 7f2809d9b640 1 -- 172.21.15.121:0/4091096702 >> v1:172.21.15.121:6789/0 conn(0x7f280c09f040 legacy=0x7f280c068d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:52:54.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.252+0000 7f280959a640 1 -- 172.21.15.121:0/4091096702 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2706946448 0 0) 0x7f280c06d370 con 0x7f280c09f040 2024-09-16T07:52:54.252 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.252+0000 7f2809d9b640 1 -- 172.21.15.121:0/4091096702 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f280c09c1c0 con 0x7f280c09e910 2024-09-16T07:52:54.252 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.252+0000 7f2809d9b640 1 --2- 172.21.15.121:0/4091096702 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f280c09e910 0x7f280c069450 crc :-1 s=READY pgs=13014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=725f1853b8f1c1d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:52:54.252 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.252+0000 7f280959a640 1 -- 172.21.15.121:0/4091096702 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2800009d90 con 0x7f280c09e910 2024-09-16T07:52:54.252 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.252+0000 7f280959a640 1 -- 172.21.15.121:0/4091096702 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f280000e230 con 0x7f280c09e910 2024-09-16T07:52:54.252 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.252+0000 7f280959a640 1 -- 172.21.15.121:0/4091096702 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f280000e4d0 con 0x7f280c09e910 2024-09-16T07:52:54.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.253+0000 7f2810b51640 1 -- 172.21.15.121:0/4091096702 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f280c09e910 msgr2=0x7f280c069450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:52:54.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.253+0000 7f2810b51640 1 --2- 172.21.15.121:0/4091096702 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f280c09e910 0x7f280c069450 crc :-1 s=READY pgs=13014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:54.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.253+0000 7f2810b51640 1 -- 172.21.15.121:0/4091096702 shutdown_connections 2024-09-16T07:52:54.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.253+0000 7f2810b51640 1 --2- 172.21.15.121:0/4091096702 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f280c09e910 0x7f280c069450 unknown :-1 s=CLOSED pgs=13014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:54.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.253+0000 7f2810b51640 1 -- 172.21.15.121:0/4091096702 >> 172.21.15.121:0/4091096702 conn(0x7f280c0a32a0 msgr2=0x7f280c0a36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:52:54.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.253+0000 7f2810b51640 1 -- 172.21.15.121:0/4091096702 shutdown_connections 2024-09-16T07:52:54.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.253+0000 7f2810b51640 1 -- 172.21.15.121:0/4091096702 wait complete. 2024-09-16T07:52:54.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.253+0000 7f2810b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:54.254 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.255+0000 7f2810b51640 1 Processor -- start 2024-09-16T07:52:54.254 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.255+0000 7f2810b51640 1 -- start start 2024-09-16T07:52:54.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.256+0000 7f2810b51640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f280c09e910 0x7f280c098f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:52:54.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.256+0000 7f2810b51640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f280c09ba00 con 0x7f280c09e910 2024-09-16T07:52:54.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.256+0000 7f280a59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f280c09e910 0x7f280c098f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:52:54.256 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.256+0000 7f280a59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f280c09e910 0x7f280c098f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40984/0 (socket says 172.21.15.121:40984) 2024-09-16T07:52:54.256 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.256+0000 7f280a59c640 1 -- 172.21.15.121:0/2913084300 learned_addr learned my addr 172.21.15.121:0/2913084300 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:52:54.256 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.256+0000 7f280a59c640 1 -- 172.21.15.121:0/2913084300 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f280c097800 con 0x7f280c09e910 2024-09-16T07:52:54.256 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.256+0000 7f280a59c640 1 --2- 172.21.15.121:0/2913084300 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f280c09e910 0x7f280c098f40 crc :-1 s=READY pgs=13015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:52:54.256 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.256+0000 7f27faffd640 1 -- 172.21.15.121:0/2913084300 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f27fc0070b0 con 0x7f280c09e910 2024-09-16T07:52:54.256 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.256+0000 7f27faffd640 1 -- 172.21.15.121:0/2913084300 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f27fc007210 con 0x7f280c09e910 2024-09-16T07:52:54.256 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.256+0000 7f2810b51640 1 -- 172.21.15.121:0/2913084300 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f280c09bf20 con 0x7f280c09e910 2024-09-16T07:52:54.256 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.257+0000 7f27faffd640 1 -- 172.21.15.121:0/2913084300 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f27fc0074b0 con 0x7f280c09e910 2024-09-16T07:52:54.256 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.257+0000 7f2810b51640 1 -- 172.21.15.121:0/2913084300 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f280c0986c0 con 0x7f280c09e910 2024-09-16T07:52:54.257 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.257+0000 7f27faffd640 1 -- 172.21.15.121:0/2913084300 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f27fc0076b0 con 0x7f280c09e910 2024-09-16T07:52:54.257 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.257+0000 7f2810b51640 1 -- 172.21.15.121:0/2913084300 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f280c068d40 con 0x7f280c09e910 2024-09-16T07:52:54.257 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.258+0000 7f27faffd640 1 --2- 172.21.15.121:0/2913084300 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f27ec03e8e0 0x7f27ec040df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:52:54.257 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.258+0000 7f27faffd640 1 -- 172.21.15.121:0/2913084300 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(723..723 src has 620..723) ==== 3431+0+0 (crc 0 0 0) 0x7f27fc0503f0 con 0x7f280c09e910 2024-09-16T07:52:54.257 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.258+0000 7f2809d9b640 1 --2- 172.21.15.121:0/2913084300 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f27ec03e8e0 0x7f27ec040df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:52:54.258 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.259+0000 7f2809d9b640 1 --2- 172.21.15.121:0/2913084300 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f27ec03e8e0 0x7f27ec040df0 crc :-1 s=READY pgs=3851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:52:54.262 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.263+0000 7f27faffd640 1 -- 172.21.15.121:0/2913084300 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f27fc009830 con 0x7f280c09e910 2024-09-16T07:52:54.439 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.441+0000 7f2810b51640 1 -- 172.21.15.121:0/2913084300 --> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f280c070340 con 0x7f27ec03e8e0 2024-09-16T07:52:54.441 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.442+0000 7f27faffd640 1 -- 172.21.15.121:0/2913084300 <== mgr.4102 v2:172.21.15.172:6800/643901738 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (crc 0 0 0) 0x7f2800009e80 con 0x7f27ec03e8e0 2024-09-16T07:52:54.441 INFO:teuthology.orchestra.run.smithi121.stderr:instructed osd(s) 1 to deep-scrub 2024-09-16T07:52:54.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.445+0000 7f2810b51640 1 -- 172.21.15.121:0/2913084300 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f27ec03e8e0 msgr2=0x7f27ec040df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:52:54.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.445+0000 7f2810b51640 1 --2- 172.21.15.121:0/2913084300 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f27ec03e8e0 0x7f27ec040df0 crc :-1 s=READY pgs=3851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:54.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.445+0000 7f2810b51640 1 -- 172.21.15.121:0/2913084300 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f280c09e910 msgr2=0x7f280c098f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:52:54.445 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.445+0000 7f2810b51640 1 --2- 172.21.15.121:0/2913084300 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f280c09e910 0x7f280c098f40 crc :-1 s=READY pgs=13015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:54.445 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.445+0000 7f2810b51640 1 -- 172.21.15.121:0/2913084300 shutdown_connections 2024-09-16T07:52:54.445 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.445+0000 7f2810b51640 1 --2- 172.21.15.121:0/2913084300 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f27ec03e8e0 0x7f27ec040df0 unknown :-1 s=CLOSED pgs=3851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:54.445 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.445+0000 7f2810b51640 1 --2- 172.21.15.121:0/2913084300 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f280c09e910 0x7f280c098f40 unknown :-1 s=CLOSED pgs=13015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:54.445 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.445+0000 7f2810b51640 1 -- 172.21.15.121:0/2913084300 >> 172.21.15.121:0/2913084300 conn(0x7f280c0a32a0 msgr2=0x7f280c072a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:52:54.445 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.445+0000 7f2810b51640 1 -- 172.21.15.121:0/2913084300 shutdown_connections 2024-09-16T07:52:54.445 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.445+0000 7f2810b51640 1 -- 172.21.15.121:0/2913084300 wait complete. 2024-09-16T07:52:54.459 INFO:tasks.ceph:Scrubbing osd.2 2024-09-16T07:52:54.459 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-16T07:52:54.575 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.567+0000 7f2293551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:54.575 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.577+0000 7f2293551640 1 Processor -- start 2024-09-16T07:52:54.575 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.577+0000 7f2293551640 1 -- start start 2024-09-16T07:52:54.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.578+0000 7f2293551640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f228c09da60 0x7f228c09de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:52:54.578 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.578+0000 7f2293551640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f228c09ee20 con 0x7f228c09e3b0 2024-09-16T07:52:54.578 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.578+0000 7f2293551640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f228c09f560 con 0x7f228c09da60 2024-09-16T07:52:54.578 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.578+0000 7f22912ed640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f228c09da60 0x7f228c09de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:52:54.578 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.578+0000 7f2290aec640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f228c09e3b0 0x7f228c135d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:49812/0 (socket says 172.21.15.121:49812) 2024-09-16T07:52:54.578 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.578+0000 7f2290aec640 1 -- 172.21.15.121:0/3767665137 learned_addr learned my addr 172.21.15.121:0/3767665137 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-16T07:52:54.578 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.578+0000 7f22912ed640 1 -- 172.21.15.121:0/3767665137 >> v1:172.21.15.121:6789/0 conn(0x7f228c09e3b0 legacy=0x7f228c135d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:52:54.578 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.578+0000 7f22912ed640 1 -- 172.21.15.121:0/3767665137 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f228c09eb10 con 0x7f228c09da60 2024-09-16T07:52:54.578 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.579+0000 7f22912ed640 1 --2- 172.21.15.121:0/3767665137 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f228c09da60 0x7f228c09de70 crc :-1 s=READY pgs=13017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34bf80f6be5a65ce server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:52:54.578 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.579+0000 7f2283fff640 1 -- 172.21.15.121:0/3767665137 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2288009d80 con 0x7f228c09da60 2024-09-16T07:52:54.578 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.579+0000 7f2283fff640 1 -- 172.21.15.121:0/3767665137 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f228800e230 con 0x7f228c09da60 2024-09-16T07:52:54.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.579+0000 7f2283fff640 1 -- 172.21.15.121:0/3767665137 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f228800e4d0 con 0x7f228c09da60 2024-09-16T07:52:54.580 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.580+0000 7f2293551640 1 -- 172.21.15.121:0/3767665137 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f228c09da60 msgr2=0x7f228c09de70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:52:54.580 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.580+0000 7f2293551640 1 --2- 172.21.15.121:0/3767665137 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f228c09da60 0x7f228c09de70 crc :-1 s=READY pgs=13017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:54.580 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.580+0000 7f2293551640 1 -- 172.21.15.121:0/3767665137 shutdown_connections 2024-09-16T07:52:54.580 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.580+0000 7f2293551640 1 --2- 172.21.15.121:0/3767665137 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f228c09da60 0x7f228c09de70 unknown :-1 s=CLOSED pgs=13017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:54.580 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.580+0000 7f2293551640 1 -- 172.21.15.121:0/3767665137 >> 172.21.15.121:0/3767665137 conn(0x7f228c06eb10 msgr2=0x7f228c06ef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:52:54.580 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.580+0000 7f2293551640 1 -- 172.21.15.121:0/3767665137 shutdown_connections 2024-09-16T07:52:54.580 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.580+0000 7f2293551640 1 -- 172.21.15.121:0/3767665137 wait complete. 2024-09-16T07:52:54.581 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.580+0000 7f2293551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:54.581 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.581+0000 7f2293551640 1 Processor -- start 2024-09-16T07:52:54.581 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.581+0000 7f2293551640 1 -- start start 2024-09-16T07:52:54.582 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.582+0000 7f2293551640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f228c09da60 0x7f228c121ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:52:54.582 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.582+0000 7f2293551640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f228c136050 con 0x7f228c09da60 2024-09-16T07:52:54.582 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.582+0000 7f22912ed640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f228c09da60 0x7f228c121ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:52:54.582 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.582+0000 7f22912ed640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f228c09da60 0x7f228c121ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41000/0 (socket says 172.21.15.121:41000) 2024-09-16T07:52:54.583 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.582+0000 7f22912ed640 1 -- 172.21.15.121:0/975431025 learned_addr learned my addr 172.21.15.121:0/975431025 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:52:54.583 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.583+0000 7f22912ed640 1 -- 172.21.15.121:0/975431025 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f228c125a10 con 0x7f228c09da60 2024-09-16T07:52:54.583 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.583+0000 7f22912ed640 1 --2- 172.21.15.121:0/975431025 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f228c09da60 0x7f228c121ba0 crc :-1 s=READY pgs=13018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:52:54.583 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.583+0000 7f2281ffb640 1 -- 172.21.15.121:0/975431025 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2288014620 con 0x7f228c09da60 2024-09-16T07:52:54.583 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.583+0000 7f2281ffb640 1 -- 172.21.15.121:0/975431025 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f2288014780 con 0x7f228c09da60 2024-09-16T07:52:54.583 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.583+0000 7f2293551640 1 -- 172.21.15.121:0/975431025 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f228c125690 con 0x7f228c09da60 2024-09-16T07:52:54.583 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.583+0000 7f2281ffb640 1 -- 172.21.15.121:0/975431025 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2288014a20 con 0x7f228c09da60 2024-09-16T07:52:54.583 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.583+0000 7f2293551640 1 -- 172.21.15.121:0/975431025 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f228c124260 con 0x7f228c09da60 2024-09-16T07:52:54.585 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.584+0000 7f2293551640 1 -- 172.21.15.121:0/975431025 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f228c125490 con 0x7f228c09da60 2024-09-16T07:52:54.585 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.584+0000 7f2281ffb640 1 -- 172.21.15.121:0/975431025 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f2288014bd0 con 0x7f228c09da60 2024-09-16T07:52:54.585 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.584+0000 7f2281ffb640 1 --2- 172.21.15.121:0/975431025 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f227003e930 0x7f2270040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:52:54.585 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.584+0000 7f2281ffb640 1 -- 172.21.15.121:0/975431025 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(723..723 src has 620..723) ==== 3431+0+0 (crc 0 0 0) 0x7f2288019040 con 0x7f228c09da60 2024-09-16T07:52:54.585 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.584+0000 7f2281ffb640 1 --2- 172.21.15.121:0/975431025 >> v2:172.21.15.172:6804/2274906412 conn(0x7f2270044a70 0x7f2270046f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:52:54.585 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.584+0000 7f2281ffb640 1 -- 172.21.15.121:0/975431025 --> v2:172.21.15.172:6804/2274906412 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f22700475f0 con 0x7f2270044a70 2024-09-16T07:52:54.585 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.584+0000 7f2281ffb640 1 -- 172.21.15.121:0/975431025 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_get_version_reply(handle=1 version=723) ==== 24+0+0 (crc 0 0 0) 0x7f2288053600 con 0x7f228c09da60 2024-09-16T07:52:54.585 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.585+0000 7f2290aec640 1 --2- 172.21.15.121:0/975431025 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f227003e930 0x7f2270040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:52:54.585 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.585+0000 7f2290aec640 1 --2- 172.21.15.121:0/975431025 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f227003e930 0x7f2270040e40 crc :-1 s=READY pgs=3852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:52:54.586 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.586+0000 7f2291aee640 1 --2- 172.21.15.121:0/975431025 >> v2:172.21.15.172:6804/2274906412 conn(0x7f2270044a70 0x7f2270046f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T07:52:54.589 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.590+0000 7f2291aee640 1 --2- 172.21.15.121:0/975431025 >> v2:172.21.15.172:6804/2274906412 conn(0x7f2270044a70 0x7f2270046f60 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:52:54.591 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.592+0000 7f2281ffb640 1 -- 172.21.15.121:0/975431025 <== osd.2 v2:172.21.15.172:6804/2274906412 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5790 (crc 0 0 0) 0x7f22700475f0 con 0x7f2270044a70 2024-09-16T07:52:54.594 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.595+0000 7f2293551640 1 -- 172.21.15.121:0/975431025 --> v2:172.21.15.172:6804/2274906412 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f228c124dd0 con 0x7f2270044a70 2024-09-16T07:52:54.596 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.598+0000 7f2281ffb640 1 -- 172.21.15.121:0/975431025 <== osd.2 v2:172.21.15.172:6804/2274906412 2 ==== command_reply(tid 2: 0 ) ==== 8+0+22 (crc 0 0 0) 0x7f228c124dd0 con 0x7f2270044a70 2024-09-16T07:52:54.597 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-16T07:52:54.597 INFO:teuthology.orchestra.run.smithi121.stdout: "success": "" 2024-09-16T07:52:54.597 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-16T07:52:54.598 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.598+0000 7f2293551640 1 -- 172.21.15.121:0/975431025 >> v2:172.21.15.172:6804/2274906412 conn(0x7f2270044a70 msgr2=0x7f2270046f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:52:54.598 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.598+0000 7f2293551640 1 --2- 172.21.15.121:0/975431025 >> v2:172.21.15.172:6804/2274906412 conn(0x7f2270044a70 0x7f2270046f60 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:54.598 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.598+0000 7f2293551640 1 -- 172.21.15.121:0/975431025 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f227003e930 msgr2=0x7f2270040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:52:54.598 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.598+0000 7f2293551640 1 --2- 172.21.15.121:0/975431025 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f227003e930 0x7f2270040e40 crc :-1 s=READY pgs=3852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:54.598 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.598+0000 7f2293551640 1 -- 172.21.15.121:0/975431025 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f228c09da60 msgr2=0x7f228c121ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:52:54.599 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.598+0000 7f2293551640 1 --2- 172.21.15.121:0/975431025 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f228c09da60 0x7f228c121ba0 crc :-1 s=READY pgs=13018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:54.599 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.598+0000 7f2293551640 1 -- 172.21.15.121:0/975431025 shutdown_connections 2024-09-16T07:52:54.599 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.598+0000 7f2293551640 1 --2- 172.21.15.121:0/975431025 >> v2:172.21.15.172:6804/2274906412 conn(0x7f2270044a70 0x7f2270046f60 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:54.599 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.598+0000 7f2293551640 1 --2- 172.21.15.121:0/975431025 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f227003e930 0x7f2270040e40 unknown :-1 s=CLOSED pgs=3852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:54.599 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.598+0000 7f2293551640 1 --2- 172.21.15.121:0/975431025 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f228c09da60 0x7f228c121ba0 unknown :-1 s=CLOSED pgs=13018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:54.599 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.598+0000 7f2293551640 1 -- 172.21.15.121:0/975431025 >> 172.21.15.121:0/975431025 conn(0x7f228c06eb10 msgr2=0x7f228c0a7200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:52:54.599 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.598+0000 7f2293551640 1 -- 172.21.15.121:0/975431025 shutdown_connections 2024-09-16T07:52:54.599 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.598+0000 7f2293551640 1 -- 172.21.15.121:0/975431025 wait complete. 2024-09-16T07:52:54.608 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-16T07:52:54.717 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.713+0000 7f624d24f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:54.717 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.719+0000 7f624d24f640 1 Processor -- start 2024-09-16T07:52:54.717 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.719+0000 7f624d24f640 1 -- start start 2024-09-16T07:52:54.719 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.720+0000 7f624d24f640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f6248135570 0x7f6248137990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:52:54.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.720+0000 7f624d24f640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6248098840 con 0x7f6248132790 2024-09-16T07:52:54.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.720+0000 7f624d24f640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f624809ac90 con 0x7f6248135570 2024-09-16T07:52:54.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.720+0000 7f623e59c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f6248135570 0x7f6248137990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:52:54.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.720+0000 7f6246d9d640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f6248132790 0x7f6248132ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:49828/0 (socket says 172.21.15.121:49828) 2024-09-16T07:52:54.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.720+0000 7f6246d9d640 1 -- 172.21.15.121:0/1148245780 learned_addr learned my addr 172.21.15.121:0/1148245780 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-16T07:52:54.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.720+0000 7f623e59c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f6248135570 0x7f6248137990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41012/0 (socket says 172.21.15.121:41012) 2024-09-16T07:52:54.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.720+0000 7f623e59c640 1 -- 172.21.15.121:0/1148245780 >> v1:172.21.15.121:6789/0 conn(0x7f6248132790 legacy=0x7f6248132ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:52:54.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.720+0000 7f623e59c640 1 -- 172.21.15.121:0/1148245780 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f624809cb70 con 0x7f6248135570 2024-09-16T07:52:54.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.720+0000 7f623e59c640 1 --2- 172.21.15.121:0/1148245780 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6248135570 0x7f6248137990 crc :-1 s=READY pgs=13020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc5548dc94f2f542 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:52:54.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.721+0000 7f624659c640 1 -- 172.21.15.121:0/1148245780 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6230009d80 con 0x7f6248135570 2024-09-16T07:52:54.721 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.721+0000 7f624659c640 1 -- 172.21.15.121:0/1148245780 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f623000e230 con 0x7f6248135570 2024-09-16T07:52:54.721 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.721+0000 7f624659c640 1 -- 172.21.15.121:0/1148245780 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f623000e4d0 con 0x7f6248135570 2024-09-16T07:52:54.722 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.721+0000 7f624d24f640 1 -- 172.21.15.121:0/1148245780 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6248135570 msgr2=0x7f6248137990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:52:54.722 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.721+0000 7f624d24f640 1 --2- 172.21.15.121:0/1148245780 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6248135570 0x7f6248137990 crc :-1 s=READY pgs=13020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:54.722 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.721+0000 7f624d24f640 1 -- 172.21.15.121:0/1148245780 shutdown_connections 2024-09-16T07:52:54.722 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.721+0000 7f624d24f640 1 --2- 172.21.15.121:0/1148245780 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6248135570 0x7f6248137990 unknown :-1 s=CLOSED pgs=13020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:54.722 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.721+0000 7f624d24f640 1 -- 172.21.15.121:0/1148245780 >> 172.21.15.121:0/1148245780 conn(0x7f62480a11f0 msgr2=0x7f62480a1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:52:54.722 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.721+0000 7f624d24f640 1 -- 172.21.15.121:0/1148245780 shutdown_connections 2024-09-16T07:52:54.722 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.721+0000 7f624d24f640 1 -- 172.21.15.121:0/1148245780 wait complete. 2024-09-16T07:52:54.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.722+0000 7f624d24f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:54.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.723+0000 7f624d24f640 1 Processor -- start 2024-09-16T07:52:54.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.723+0000 7f624d24f640 1 -- start start 2024-09-16T07:52:54.724 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.724+0000 7f624d24f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6248132790 0x7f624812c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:52:54.724 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.724+0000 7f624d24f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f624812ccc0 con 0x7f6248132790 2024-09-16T07:52:54.725 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.724+0000 7f6246d9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6248132790 0x7f624812c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:52:54.725 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.724+0000 7f6246d9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6248132790 0x7f624812c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41018/0 (socket says 172.21.15.121:41018) 2024-09-16T07:52:54.725 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.724+0000 7f6246d9d640 1 -- 172.21.15.121:0/2099192616 learned_addr learned my addr 172.21.15.121:0/2099192616 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:52:54.725 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.725+0000 7f6246d9d640 1 -- 172.21.15.121:0/2099192616 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6248134680 con 0x7f6248132790 2024-09-16T07:52:54.725 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.725+0000 7f6246d9d640 1 --2- 172.21.15.121:0/2099192616 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6248132790 0x7f624812c290 crc :-1 s=READY pgs=13021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:52:54.725 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.725+0000 7f623ffff640 1 -- 172.21.15.121:0/2099192616 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6238005a60 con 0x7f6248132790 2024-09-16T07:52:54.725 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.725+0000 7f623ffff640 1 -- 172.21.15.121:0/2099192616 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f6238005bc0 con 0x7f6248132790 2024-09-16T07:52:54.725 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.725+0000 7f624d24f640 1 -- 172.21.15.121:0/2099192616 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f624812c990 con 0x7f6248132790 2024-09-16T07:52:54.725 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.725+0000 7f623ffff640 1 -- 172.21.15.121:0/2099192616 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6238005e60 con 0x7f6248132790 2024-09-16T07:52:54.725 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.725+0000 7f624d24f640 1 -- 172.21.15.121:0/2099192616 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62481301d0 con 0x7f6248132790 2024-09-16T07:52:54.726 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.726+0000 7f624d24f640 1 -- 172.21.15.121:0/2099192616 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6248132ba0 con 0x7f6248132790 2024-09-16T07:52:54.726 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.726+0000 7f623ffff640 1 -- 172.21.15.121:0/2099192616 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f62380070b0 con 0x7f6248132790 2024-09-16T07:52:54.726 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.726+0000 7f623ffff640 1 --2- 172.21.15.121:0/2099192616 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f622803e930 0x7f6228040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:52:54.726 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.727+0000 7f623ffff640 1 -- 172.21.15.121:0/2099192616 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(723..723 src has 620..723) ==== 3431+0+0 (crc 0 0 0) 0x7f623804f950 con 0x7f6248132790 2024-09-16T07:52:54.726 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.727+0000 7f623e59c640 1 --2- 172.21.15.121:0/2099192616 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f622803e930 0x7f6228040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:52:54.727 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.727+0000 7f623e59c640 1 --2- 172.21.15.121:0/2099192616 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f622803e930 0x7f6228040e40 crc :-1 s=READY pgs=3853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:52:54.730 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.732+0000 7f623ffff640 1 -- 172.21.15.121:0/2099192616 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f623800dc60 con 0x7f6248132790 2024-09-16T07:52:54.909 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.910+0000 7f624d24f640 1 -- 172.21.15.121:0/2099192616 --> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f6248130f50 con 0x7f622803e930 2024-09-16T07:52:54.909 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.911+0000 7f623ffff640 1 -- 172.21.15.121:0/2099192616 <== mgr.4102 v2:172.21.15.172:6800/643901738 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (crc 0 0 0) 0x7f6230009e70 con 0x7f622803e930 2024-09-16T07:52:54.910 INFO:teuthology.orchestra.run.smithi121.stderr:instructed osd(s) 2 to deep-scrub 2024-09-16T07:52:54.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.913+0000 7f624d24f640 1 -- 172.21.15.121:0/2099192616 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f622803e930 msgr2=0x7f6228040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:52:54.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.913+0000 7f624d24f640 1 --2- 172.21.15.121:0/2099192616 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f622803e930 0x7f6228040e40 crc :-1 s=READY pgs=3853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:54.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.913+0000 7f624d24f640 1 -- 172.21.15.121:0/2099192616 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6248132790 msgr2=0x7f624812c290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:52:54.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.913+0000 7f624d24f640 1 --2- 172.21.15.121:0/2099192616 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6248132790 0x7f624812c290 crc :-1 s=READY pgs=13021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:54.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.913+0000 7f624d24f640 1 -- 172.21.15.121:0/2099192616 shutdown_connections 2024-09-16T07:52:54.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.913+0000 7f624d24f640 1 --2- 172.21.15.121:0/2099192616 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f622803e930 0x7f6228040e40 unknown :-1 s=CLOSED pgs=3853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:54.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.913+0000 7f624d24f640 1 --2- 172.21.15.121:0/2099192616 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6248132790 0x7f624812c290 unknown :-1 s=CLOSED pgs=13021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:54.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.913+0000 7f624d24f640 1 -- 172.21.15.121:0/2099192616 >> 172.21.15.121:0/2099192616 conn(0x7f62480a11f0 msgr2=0x7f6248131720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:52:54.913 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.913+0000 7f624d24f640 1 -- 172.21.15.121:0/2099192616 shutdown_connections 2024-09-16T07:52:54.913 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:54.913+0000 7f624d24f640 1 -- 172.21.15.121:0/2099192616 wait complete. 2024-09-16T07:52:54.925 INFO:tasks.ceph:Scrubbing osd.3 2024-09-16T07:52:54.925 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-16T07:52:55.037 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.030+0000 7f0230d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:55.038 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.039+0000 7f0230d91640 1 Processor -- start 2024-09-16T07:52:55.038 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.040+0000 7f0230d91640 1 -- start start 2024-09-16T07:52:55.041 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.041+0000 7f0230d91640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f022c1351e0 0x7f022c1355f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:52:55.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.041+0000 7f0230d91640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f022c09de10 con 0x7f022c135e80 2024-09-16T07:52:55.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.041+0000 7f0230d91640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f022c0a12d0 con 0x7f022c1351e0 2024-09-16T07:52:55.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.041+0000 7f022a59c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f022c1351e0 0x7f022c1355f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:52:55.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.041+0000 7f0229d9b640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f022c135e80 0x7f022c136290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:49842/0 (socket says 172.21.15.121:49842) 2024-09-16T07:52:55.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.041+0000 7f022a59c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f022c1351e0 0x7f022c1355f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41026/0 (socket says 172.21.15.121:41026) 2024-09-16T07:52:55.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.041+0000 7f0229d9b640 1 -- 172.21.15.121:0/1279876967 learned_addr learned my addr 172.21.15.121:0/1279876967 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-16T07:52:55.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.041+0000 7f022a59c640 1 -- 172.21.15.121:0/1279876967 >> v1:172.21.15.121:6789/0 conn(0x7f022c135e80 legacy=0x7f022c136290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:52:55.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.041+0000 7f022959a640 1 -- 172.21.15.121:0/1279876967 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2602485620 0 0) 0x7f022c09de10 con 0x7f022c135e80 2024-09-16T07:52:55.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.041+0000 7f022a59c640 1 -- 172.21.15.121:0/1279876967 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f022c09f6c0 con 0x7f022c1351e0 2024-09-16T07:52:55.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.041+0000 7f022a59c640 1 --2- 172.21.15.121:0/1279876967 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f022c1351e0 0x7f022c1355f0 crc :-1 s=READY pgs=13023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d227b1958f5c3dc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:52:55.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.042+0000 7f022959a640 1 -- 172.21.15.121:0/1279876967 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f021c00e040 con 0x7f022c1351e0 2024-09-16T07:52:55.043 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.042+0000 7f022959a640 1 -- 172.21.15.121:0/1279876967 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f021c007670 con 0x7f022c1351e0 2024-09-16T07:52:55.043 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.042+0000 7f022959a640 1 -- 172.21.15.121:0/1279876967 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f021c007910 con 0x7f022c1351e0 2024-09-16T07:52:55.043 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.042+0000 7f0230d91640 1 -- 172.21.15.121:0/1279876967 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f022c1351e0 msgr2=0x7f022c1355f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:52:55.043 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.042+0000 7f0230d91640 1 --2- 172.21.15.121:0/1279876967 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f022c1351e0 0x7f022c1355f0 crc :-1 s=READY pgs=13023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:55.043 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.042+0000 7f0230d91640 1 -- 172.21.15.121:0/1279876967 shutdown_connections 2024-09-16T07:52:55.043 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.042+0000 7f0230d91640 1 --2- 172.21.15.121:0/1279876967 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f022c1351e0 0x7f022c1355f0 unknown :-1 s=CLOSED pgs=13023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:55.043 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.042+0000 7f0230d91640 1 -- 172.21.15.121:0/1279876967 >> 172.21.15.121:0/1279876967 conn(0x7f022c06ea30 msgr2=0x7f022c06ee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:52:55.043 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.042+0000 7f0230d91640 1 -- 172.21.15.121:0/1279876967 shutdown_connections 2024-09-16T07:52:55.043 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.042+0000 7f0230d91640 1 -- 172.21.15.121:0/1279876967 wait complete. 2024-09-16T07:52:55.043 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.043+0000 7f0230d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:55.045 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.044+0000 7f0230d91640 1 Processor -- start 2024-09-16T07:52:55.045 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.044+0000 7f0230d91640 1 -- start start 2024-09-16T07:52:55.045 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.045+0000 7f0230d91640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f022c1351e0 0x7f022c120990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:52:55.046 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.045+0000 7f0230d91640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f022c121cd0 con 0x7f022c1351e0 2024-09-16T07:52:55.046 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.045+0000 7f022a59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f022c1351e0 0x7f022c120990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:52:55.046 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.045+0000 7f022a59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f022c1351e0 0x7f022c120990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41040/0 (socket says 172.21.15.121:41040) 2024-09-16T07:52:55.046 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.045+0000 7f022a59c640 1 -- 172.21.15.121:0/1230812390 learned_addr learned my addr 172.21.15.121:0/1230812390 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:52:55.046 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.046+0000 7f022a59c640 1 -- 172.21.15.121:0/1230812390 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f022c0a4a30 con 0x7f022c1351e0 2024-09-16T07:52:55.046 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.046+0000 7f022a59c640 1 --2- 172.21.15.121:0/1230812390 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f022c1351e0 0x7f022c120990 crc :-1 s=READY pgs=13024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:52:55.046 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.046+0000 7f0222ffd640 1 -- 172.21.15.121:0/1230812390 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f021c00e040 con 0x7f022c1351e0 2024-09-16T07:52:55.046 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.046+0000 7f0222ffd640 1 -- 172.21.15.121:0/1230812390 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f021c013aa0 con 0x7f022c1351e0 2024-09-16T07:52:55.046 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.046+0000 7f0230d91640 1 -- 172.21.15.121:0/1230812390 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f022c1248e0 con 0x7f022c1351e0 2024-09-16T07:52:55.046 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.046+0000 7f0222ffd640 1 -- 172.21.15.121:0/1230812390 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f021c013d40 con 0x7f022c1351e0 2024-09-16T07:52:55.046 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.046+0000 7f0230d91640 1 -- 172.21.15.121:0/1230812390 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f022c134af0 con 0x7f022c1351e0 2024-09-16T07:52:55.047 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.047+0000 7f0230d91640 1 -- 172.21.15.121:0/1230812390 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f022c0a0780 con 0x7f022c1351e0 2024-09-16T07:52:55.047 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.047+0000 7f0222ffd640 1 -- 172.21.15.121:0/1230812390 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f021c011040 con 0x7f022c1351e0 2024-09-16T07:52:55.048 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.047+0000 7f0222ffd640 1 --2- 172.21.15.121:0/1230812390 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f020c03e930 0x7f020c040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:52:55.048 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.047+0000 7f0222ffd640 1 -- 172.21.15.121:0/1230812390 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(723..723 src has 620..723) ==== 3431+0+0 (crc 0 0 0) 0x7f021c051210 con 0x7f022c1351e0 2024-09-16T07:52:55.048 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.047+0000 7f0222ffd640 1 --2- 172.21.15.121:0/1230812390 >> v2:172.21.15.172:6808/3418488586 conn(0x7f020c044a70 0x7f020c046f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:52:55.048 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.047+0000 7f0222ffd640 1 -- 172.21.15.121:0/1230812390 --> v2:172.21.15.172:6808/3418488586 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f020c0475f0 con 0x7f020c044a70 2024-09-16T07:52:55.048 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.047+0000 7f0222ffd640 1 -- 172.21.15.121:0/1230812390 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_get_version_reply(handle=1 version=723) ==== 24+0+0 (crc 0 0 0) 0x7f021c053700 con 0x7f022c1351e0 2024-09-16T07:52:55.048 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.048+0000 7f0229d9b640 1 --2- 172.21.15.121:0/1230812390 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f020c03e930 0x7f020c040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:52:55.048 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.048+0000 7f0229d9b640 1 --2- 172.21.15.121:0/1230812390 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f020c03e930 0x7f020c040e40 crc :-1 s=READY pgs=3854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:52:55.048 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.048+0000 7f022ad9d640 1 --2- 172.21.15.121:0/1230812390 >> v2:172.21.15.172:6808/3418488586 conn(0x7f020c044a70 0x7f020c046f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-16T07:52:55.050 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.051+0000 7f022ad9d640 1 --2- 172.21.15.121:0/1230812390 >> v2:172.21.15.172:6808/3418488586 conn(0x7f020c044a70 0x7f020c046f60 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:52:55.051 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.053+0000 7f0222ffd640 1 -- 172.21.15.121:0/1230812390 <== osd.3 v2:172.21.15.172:6808/3418488586 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5790 (crc 0 0 0) 0x7f020c0475f0 con 0x7f020c044a70 2024-09-16T07:52:55.055 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.056+0000 7f0230d91640 1 -- 172.21.15.121:0/1230812390 --> v2:172.21.15.172:6808/3418488586 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f022c135b30 con 0x7f020c044a70 2024-09-16T07:52:55.056 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.058+0000 7f0222ffd640 1 -- 172.21.15.121:0/1230812390 <== osd.3 v2:172.21.15.172:6808/3418488586 2 ==== command_reply(tid 2: 0 ) ==== 8+0+22 (crc 0 0 0) 0x7f0224009830 con 0x7f020c044a70 2024-09-16T07:52:55.057 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-16T07:52:55.057 INFO:teuthology.orchestra.run.smithi121.stdout: "success": "" 2024-09-16T07:52:55.057 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-16T07:52:55.058 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.058+0000 7f0230d91640 1 -- 172.21.15.121:0/1230812390 >> v2:172.21.15.172:6808/3418488586 conn(0x7f020c044a70 msgr2=0x7f020c046f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:52:55.058 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.058+0000 7f0230d91640 1 --2- 172.21.15.121:0/1230812390 >> v2:172.21.15.172:6808/3418488586 conn(0x7f020c044a70 0x7f020c046f60 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:55.058 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.058+0000 7f0230d91640 1 -- 172.21.15.121:0/1230812390 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f020c03e930 msgr2=0x7f020c040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:52:55.058 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.058+0000 7f0230d91640 1 --2- 172.21.15.121:0/1230812390 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f020c03e930 0x7f020c040e40 crc :-1 s=READY pgs=3854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:55.058 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.058+0000 7f0230d91640 1 -- 172.21.15.121:0/1230812390 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f022c1351e0 msgr2=0x7f022c120990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:52:55.059 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.058+0000 7f0230d91640 1 --2- 172.21.15.121:0/1230812390 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f022c1351e0 0x7f022c120990 crc :-1 s=READY pgs=13024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:55.059 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.058+0000 7f0230d91640 1 -- 172.21.15.121:0/1230812390 shutdown_connections 2024-09-16T07:52:55.059 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.058+0000 7f0230d91640 1 --2- 172.21.15.121:0/1230812390 >> v2:172.21.15.172:6808/3418488586 conn(0x7f020c044a70 0x7f020c046f60 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:55.059 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.058+0000 7f0230d91640 1 --2- 172.21.15.121:0/1230812390 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f020c03e930 0x7f020c040e40 unknown :-1 s=CLOSED pgs=3854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:55.059 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.058+0000 7f0230d91640 1 --2- 172.21.15.121:0/1230812390 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f022c1351e0 0x7f022c120990 unknown :-1 s=CLOSED pgs=13024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:55.059 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.058+0000 7f0230d91640 1 -- 172.21.15.121:0/1230812390 >> 172.21.15.121:0/1230812390 conn(0x7f022c06ea30 msgr2=0x7f022c09de10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:52:55.059 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.058+0000 7f0230d91640 1 -- 172.21.15.121:0/1230812390 shutdown_connections 2024-09-16T07:52:55.059 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.058+0000 7f0230d91640 1 -- 172.21.15.121:0/1230812390 wait complete. 2024-09-16T07:52:55.068 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-16T07:52:55.177 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.173+0000 7fbf33391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:55.177 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.179+0000 7fbf33391640 1 Processor -- start 2024-09-16T07:52:55.177 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.179+0000 7fbf33391640 1 -- start start 2024-09-16T07:52:55.181 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.180+0000 7fbf33391640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fbf2c130250 0x7fbf2c137ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:52:55.181 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.180+0000 7fbf33391640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf2c09ddb0 con 0x7fbf2c12f730 2024-09-16T07:52:55.181 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.180+0000 7fbf33391640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fbf2c09dfe0 con 0x7fbf2c130250 2024-09-16T07:52:55.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.180+0000 7fbf3112d640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fbf2c12f730 0x7fbf2c12fb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:49852/0 (socket says 172.21.15.121:49852) 2024-09-16T07:52:55.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.180+0000 7fbf3112d640 1 -- 172.21.15.121:0/3808050734 learned_addr learned my addr 172.21.15.121:0/3808050734 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-16T07:52:55.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.180+0000 7fbf3092c640 1 --2- 172.21.15.121:0/3808050734 >> v2:172.21.15.121:3300/0 conn(0x7fbf2c130250 0x7fbf2c137ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:52:55.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.180+0000 7fbf3092c640 1 -- 172.21.15.121:0/3808050734 >> v1:172.21.15.121:6789/0 conn(0x7fbf2c12f730 legacy=0x7fbf2c12fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:52:55.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.180+0000 7fbf23fff640 1 -- 172.21.15.121:0/3808050734 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 130649407 0 0) 0x7fbf2c09ddb0 con 0x7fbf2c12f730 2024-09-16T07:52:55.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.180+0000 7fbf3092c640 1 -- 172.21.15.121:0/3808050734 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf2c098180 con 0x7fbf2c130250 2024-09-16T07:52:55.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.181+0000 7fbf3092c640 1 --2- 172.21.15.121:0/3808050734 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbf2c130250 0x7fbf2c137ec0 crc :-1 s=READY pgs=13026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db21a3d68e9390c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:52:55.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.181+0000 7fbf23fff640 1 -- 172.21.15.121:0/3808050734 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbf1c009d90 con 0x7fbf2c130250 2024-09-16T07:52:55.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.181+0000 7fbf23fff640 1 -- 172.21.15.121:0/3808050734 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fbf1c00e230 con 0x7fbf2c130250 2024-09-16T07:52:55.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.181+0000 7fbf23fff640 1 -- 172.21.15.121:0/3808050734 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbf1c00e4d0 con 0x7fbf2c130250 2024-09-16T07:52:55.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.181+0000 7fbf33391640 1 -- 172.21.15.121:0/3808050734 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbf2c130250 msgr2=0x7fbf2c137ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:52:55.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.181+0000 7fbf33391640 1 --2- 172.21.15.121:0/3808050734 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbf2c130250 0x7fbf2c137ec0 crc :-1 s=READY pgs=13026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:55.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.181+0000 7fbf33391640 1 -- 172.21.15.121:0/3808050734 shutdown_connections 2024-09-16T07:52:55.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.181+0000 7fbf33391640 1 --2- 172.21.15.121:0/3808050734 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbf2c130250 0x7fbf2c137ec0 unknown :-1 s=CLOSED pgs=13026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:55.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.181+0000 7fbf33391640 1 -- 172.21.15.121:0/3808050734 >> 172.21.15.121:0/3808050734 conn(0x7fbf2c0a11f0 msgr2=0x7fbf2c0a1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:52:55.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.182+0000 7fbf33391640 1 -- 172.21.15.121:0/3808050734 shutdown_connections 2024-09-16T07:52:55.184 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.182+0000 7fbf33391640 1 -- 172.21.15.121:0/3808050734 wait complete. 2024-09-16T07:52:55.184 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.182+0000 7fbf33391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:55.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.183+0000 7fbf33391640 1 Processor -- start 2024-09-16T07:52:55.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.183+0000 7fbf33391640 1 -- start start 2024-09-16T07:52:55.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.184+0000 7fbf33391640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbf2c12f730 0x7fbf2c06efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:52:55.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.184+0000 7fbf33391640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbf2c071660 con 0x7fbf2c12f730 2024-09-16T07:52:55.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.184+0000 7fbf3112d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbf2c12f730 0x7fbf2c06efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:52:55.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.184+0000 7fbf3112d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbf2c12f730 0x7fbf2c06efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41050/0 (socket says 172.21.15.121:41050) 2024-09-16T07:52:55.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.184+0000 7fbf3112d640 1 -- 172.21.15.121:0/1619761443 learned_addr learned my addr 172.21.15.121:0/1619761443 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:52:55.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.185+0000 7fbf3112d640 1 -- 172.21.15.121:0/1619761443 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf2c12e9e0 con 0x7fbf2c12f730 2024-09-16T07:52:55.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.185+0000 7fbf3112d640 1 --2- 172.21.15.121:0/1619761443 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbf2c12f730 0x7fbf2c06efd0 crc :-1 s=READY pgs=13027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:52:55.188 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.185+0000 7fbf21ffb640 1 -- 172.21.15.121:0/1619761443 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbf28004b80 con 0x7fbf2c12f730 2024-09-16T07:52:55.188 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.185+0000 7fbf21ffb640 1 -- 172.21.15.121:0/1619761443 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fbf28004ce0 con 0x7fbf2c12f730 2024-09-16T07:52:55.188 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.185+0000 7fbf33391640 1 -- 172.21.15.121:0/1619761443 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf2c071850 con 0x7fbf2c12f730 2024-09-16T07:52:55.188 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.185+0000 7fbf21ffb640 1 -- 172.21.15.121:0/1619761443 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbf28007120 con 0x7fbf2c12f730 2024-09-16T07:52:55.188 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.185+0000 7fbf33391640 1 -- 172.21.15.121:0/1619761443 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf2c074dc0 con 0x7fbf2c12f730 2024-09-16T07:52:55.188 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.186+0000 7fbf21ffb640 1 -- 172.21.15.121:0/1619761443 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fbf280072d0 con 0x7fbf2c12f730 2024-09-16T07:52:55.188 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.186+0000 7fbf33391640 1 -- 172.21.15.121:0/1619761443 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf2c12fb40 con 0x7fbf2c12f730 2024-09-16T07:52:55.188 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.186+0000 7fbf21ffb640 1 --2- 172.21.15.121:0/1619761443 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fbf1003e930 0x7fbf10040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:52:55.188 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.186+0000 7fbf21ffb640 1 -- 172.21.15.121:0/1619761443 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(723..723 src has 620..723) ==== 3431+0+0 (crc 0 0 0) 0x7fbf2804fa10 con 0x7fbf2c12f730 2024-09-16T07:52:55.188 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.187+0000 7fbf3092c640 1 --2- 172.21.15.121:0/1619761443 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fbf1003e930 0x7fbf10040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:52:55.188 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.187+0000 7fbf3092c640 1 --2- 172.21.15.121:0/1619761443 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fbf1003e930 0x7fbf10040e40 crc :-1 s=READY pgs=3855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:52:55.190 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.192+0000 7fbf21ffb640 1 -- 172.21.15.121:0/1619761443 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fbf2800f230 con 0x7fbf2c12f730 2024-09-16T07:52:55.368 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.369+0000 7fbf33391640 1 -- 172.21.15.121:0/1619761443 --> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fbf2c098a10 con 0x7fbf1003e930 2024-09-16T07:52:55.368 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.370+0000 7fbf21ffb640 1 -- 172.21.15.121:0/1619761443 <== mgr.4102 v2:172.21.15.172:6800/643901738 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (crc 0 0 0) 0x7fbf1c00e3a0 con 0x7fbf1003e930 2024-09-16T07:52:55.368 INFO:teuthology.orchestra.run.smithi121.stderr:instructed osd(s) 3 to deep-scrub 2024-09-16T07:52:55.372 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.372+0000 7fbf33391640 1 -- 172.21.15.121:0/1619761443 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fbf1003e930 msgr2=0x7fbf10040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:52:55.372 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.372+0000 7fbf33391640 1 --2- 172.21.15.121:0/1619761443 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fbf1003e930 0x7fbf10040e40 crc :-1 s=READY pgs=3855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:55.372 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.372+0000 7fbf33391640 1 -- 172.21.15.121:0/1619761443 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbf2c12f730 msgr2=0x7fbf2c06efd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:52:55.372 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.372+0000 7fbf33391640 1 --2- 172.21.15.121:0/1619761443 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbf2c12f730 0x7fbf2c06efd0 crc :-1 s=READY pgs=13027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:55.372 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.372+0000 7fbf33391640 1 -- 172.21.15.121:0/1619761443 shutdown_connections 2024-09-16T07:52:55.372 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.372+0000 7fbf33391640 1 --2- 172.21.15.121:0/1619761443 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fbf1003e930 0x7fbf10040e40 unknown :-1 s=CLOSED pgs=3855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:55.372 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.372+0000 7fbf33391640 1 --2- 172.21.15.121:0/1619761443 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbf2c12f730 0x7fbf2c06efd0 unknown :-1 s=CLOSED pgs=13027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:55.372 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.372+0000 7fbf33391640 1 -- 172.21.15.121:0/1619761443 >> 172.21.15.121:0/1619761443 conn(0x7fbf2c0a11f0 msgr2=0x7fbf2c132930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:52:55.372 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.372+0000 7fbf33391640 1 -- 172.21.15.121:0/1619761443 shutdown_connections 2024-09-16T07:52:55.372 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.372+0000 7fbf33391640 1 -- 172.21.15.121:0/1619761443 wait complete. 2024-09-16T07:52:55.383 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:52:55.492 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.489+0000 7fcee7874640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:55.493 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.494+0000 7fcee7874640 1 Processor -- start 2024-09-16T07:52:55.493 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.494+0000 7fcee7874640 1 -- start start 2024-09-16T07:52:55.495 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.495+0000 7fcee7874640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fcee0132790 0x7fcee0132ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:52:55.495 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.495+0000 7fcee7874640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcee0098840 con 0x7fcee009b680 2024-09-16T07:52:55.495 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.495+0000 7fcee7874640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fcee009ac90 con 0x7fcee0132790 2024-09-16T07:52:55.495 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.495+0000 7fcee5610640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fcee0132790 0x7fcee0132ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:52:55.495 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.496+0000 7fcee5610640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fcee0132790 0x7fcee0132ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41054/0 (socket says 172.21.15.121:41054) 2024-09-16T07:52:55.495 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.496+0000 7fcee5610640 1 -- 172.21.15.121:0/1428537307 learned_addr learned my addr 172.21.15.121:0/1428537307 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:52:55.496 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.496+0000 7fcee4e0f640 1 --1- 172.21.15.121:0/1428537307 >> v1:172.21.15.121:6789/0 conn(0x7fcee009b680 0x7fcee009ba90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:49856/0 (socket says 172.21.15.121:49856) 2024-09-16T07:52:55.496 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.496+0000 7fcee5610640 1 -- 172.21.15.121:0/1428537307 >> v1:172.21.15.121:6789/0 conn(0x7fcee009b680 legacy=0x7fcee009ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:52:55.496 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.496+0000 7fcee5610640 1 -- 172.21.15.121:0/1428537307 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcee009cb70 con 0x7fcee0132790 2024-09-16T07:52:55.496 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.496+0000 7fcee5610640 1 --2- 172.21.15.121:0/1428537307 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcee0132790 0x7fcee0132ba0 crc :-1 s=READY pgs=13029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e8bb914b41a5497 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:52:55.496 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.496+0000 7fced7fff640 1 -- 172.21.15.121:0/1428537307 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fcedc00d580 con 0x7fcee0132790 2024-09-16T07:52:55.496 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.496+0000 7fced7fff640 1 -- 172.21.15.121:0/1428537307 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fcedc00d6e0 con 0x7fcee0132790 2024-09-16T07:52:55.496 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.496+0000 7fced7fff640 1 -- 172.21.15.121:0/1428537307 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fcedc00d980 con 0x7fcee0132790 2024-09-16T07:52:55.497 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.497+0000 7fcee7874640 1 -- 172.21.15.121:0/1428537307 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcee0132790 msgr2=0x7fcee0132ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:52:55.497 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.497+0000 7fcee7874640 1 --2- 172.21.15.121:0/1428537307 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcee0132790 0x7fcee0132ba0 crc :-1 s=READY pgs=13029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:55.497 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.497+0000 7fcee7874640 1 -- 172.21.15.121:0/1428537307 shutdown_connections 2024-09-16T07:52:55.497 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.497+0000 7fcee7874640 1 --2- 172.21.15.121:0/1428537307 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcee0132790 0x7fcee0132ba0 unknown :-1 s=CLOSED pgs=13029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:55.497 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.497+0000 7fcee7874640 1 -- 172.21.15.121:0/1428537307 >> 172.21.15.121:0/1428537307 conn(0x7fcee00a11f0 msgr2=0x7fcee00a1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:52:55.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.497+0000 7fcee7874640 1 -- 172.21.15.121:0/1428537307 shutdown_connections 2024-09-16T07:52:55.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.497+0000 7fcee7874640 1 -- 172.21.15.121:0/1428537307 wait complete. 2024-09-16T07:52:55.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.497+0000 7fcee7874640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:55.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.498+0000 7fcee7874640 1 Processor -- start 2024-09-16T07:52:55.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.499+0000 7fcee7874640 1 -- start start 2024-09-16T07:52:55.499 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.500+0000 7fcee7874640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcee009b680 0x7fcee012a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:52:55.499 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.500+0000 7fcee7874640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fcee012b3f0 con 0x7fcee009b680 2024-09-16T07:52:55.499 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.500+0000 7fcee5610640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcee009b680 0x7fcee012a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:52:55.500 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.500+0000 7fcee5610640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcee009b680 0x7fcee012a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41060/0 (socket says 172.21.15.121:41060) 2024-09-16T07:52:55.500 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.500+0000 7fcee5610640 1 -- 172.21.15.121:0/693448661 learned_addr learned my addr 172.21.15.121:0/693448661 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:52:55.500 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.500+0000 7fcee5610640 1 -- 172.21.15.121:0/693448661 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcee01311d0 con 0x7fcee009b680 2024-09-16T07:52:55.500 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.500+0000 7fcee5610640 1 --2- 172.21.15.121:0/693448661 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcee009b680 0x7fcee012a0b0 crc :-1 s=READY pgs=13030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:52:55.500 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.500+0000 7fced5ffb640 1 -- 172.21.15.121:0/693448661 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fcedc00c800 con 0x7fcee009b680 2024-09-16T07:52:55.500 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.500+0000 7fced5ffb640 1 -- 172.21.15.121:0/693448661 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fcedc00c960 con 0x7fcee009b680 2024-09-16T07:52:55.500 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.500+0000 7fcee7874640 1 -- 172.21.15.121:0/693448661 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcee012e090 con 0x7fcee009b680 2024-09-16T07:52:55.500 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.500+0000 7fced5ffb640 1 -- 172.21.15.121:0/693448661 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fcedc00cc00 con 0x7fcee009b680 2024-09-16T07:52:55.500 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.500+0000 7fcee7874640 1 -- 172.21.15.121:0/693448661 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcee0131d50 con 0x7fcee009b680 2024-09-16T07:52:55.501 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.501+0000 7fced5ffb640 1 -- 172.21.15.121:0/693448661 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fcedc015040 con 0x7fcee009b680 2024-09-16T07:52:55.501 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.501+0000 7fced5ffb640 1 --2- 172.21.15.121:0/693448661 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fcec403e930 0x7fcec4040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:52:55.501 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.501+0000 7fced5ffb640 1 -- 172.21.15.121:0/693448661 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(723..723 src has 620..723) ==== 3431+0+0 (crc 0 0 0) 0x7fcedc012040 con 0x7fcee009b680 2024-09-16T07:52:55.501 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.502+0000 7fcee7874640 1 -- 172.21.15.121:0/693448661 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcee009e480 con 0x7fcee009b680 2024-09-16T07:52:55.501 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.502+0000 7fcee4e0f640 1 --2- 172.21.15.121:0/693448661 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fcec403e930 0x7fcec4040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:52:55.501 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.502+0000 7fcee4e0f640 1 --2- 172.21.15.121:0/693448661 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fcec403e930 0x7fcec4040e40 crc :-1 s=READY pgs=3856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:52:55.506 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.507+0000 7fced5ffb640 1 -- 172.21.15.121:0/693448661 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fcedc0175c0 con 0x7fcee009b680 2024-09-16T07:52:55.678 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.680+0000 7fcee7874640 1 -- 172.21.15.121:0/693448661 --> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcee009a1a0 con 0x7fcec403e930 2024-09-16T07:52:55.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.682+0000 7fced5ffb640 1 -- 172.21.15.121:0/693448661 <== mgr.4102 v2:172.21.15.172:6800/643901738 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+109227 (crc 0 0 0) 0x7fcee009a1a0 con 0x7fcec403e930 2024-09-16T07:52:55.682 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:52:55.682 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-09-16T07:52:55.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.685+0000 7fcee7874640 1 -- 172.21.15.121:0/693448661 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fcec403e930 msgr2=0x7fcec4040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:52:55.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.685+0000 7fcee7874640 1 --2- 172.21.15.121:0/693448661 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fcec403e930 0x7fcec4040e40 crc :-1 s=READY pgs=3856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:55.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.685+0000 7fcee7874640 1 -- 172.21.15.121:0/693448661 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcee009b680 msgr2=0x7fcee012a0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:52:55.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.685+0000 7fcee7874640 1 --2- 172.21.15.121:0/693448661 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcee009b680 0x7fcee012a0b0 crc :-1 s=READY pgs=13030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:55.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.685+0000 7fcee7874640 1 -- 172.21.15.121:0/693448661 shutdown_connections 2024-09-16T07:52:55.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.685+0000 7fcee7874640 1 --2- 172.21.15.121:0/693448661 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7fcec403e930 0x7fcec4040e40 unknown :-1 s=CLOSED pgs=3856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:55.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.685+0000 7fcee7874640 1 --2- 172.21.15.121:0/693448661 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcee009b680 0x7fcee012a0b0 unknown :-1 s=CLOSED pgs=13030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:52:55.685 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.685+0000 7fcee7874640 1 -- 172.21.15.121:0/693448661 >> 172.21.15.121:0/693448661 conn(0x7fcee00a11f0 msgr2=0x7fcee006efd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:52:55.685 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.685+0000 7fcee7874640 1 -- 172.21.15.121:0/693448661 shutdown_connections 2024-09-16T07:52:55.685 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:52:55.685+0000 7fcee7874640 1 -- 172.21.15.121:0/693448661 wait complete. 2024-09-16T07:52:55.696 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":1288,"stamp":"2024-09-16T07:52:55.129837+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590392,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":52,"num_write":88,"num_write_kb":1115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":62,"ondisk_log_size":62,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":255936,"kb_used_data":7040,"kb_used_omap":0,"kb_used_meta":248832,"kb_avail":377231424,"statfs":{"total":386547056640,"available":386284978176,"internally_reserved":0,"allocated":7208960,"data_stored":3478166,"data_compressed":189624,"data_compressed_allocated":262144,"data_compressed_original":1417216,"omap_allocated":0,"internal_metadata":254803968},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-321875,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-25,"num_write_kb":-325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001932"},"pg_stats":[{"pgid":"75.1f","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.604966+0000","last_change":"2024-09-16T07:38:56.550066+0000","last_active":"2024-09-16T07:52:49.604966+0000","last_peered":"2024-09-16T07:52:49.604966+0000","last_clean":"2024-09-16T07:52:49.604966+0000","last_became_active":"2024-09-16T07:38:56.541997+0000","last_became_peered":"2024-09-16T07:38:56.541997+0000","last_unstale":"2024-09-16T07:52:49.604966+0000","last_undegraded":"2024-09-16T07:52:49.604966+0000","last_fullsized":"2024-09-16T07:52:49.604966+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1e","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.627314+0000","last_change":"2024-09-16T07:38:56.566272+0000","last_active":"2024-09-16T07:52:49.627314+0000","last_peered":"2024-09-16T07:52:49.627314+0000","last_clean":"2024-09-16T07:52:49.627314+0000","last_became_active":"2024-09-16T07:38:56.548814+0000","last_became_peered":"2024-09-16T07:38:56.548814+0000","last_unstale":"2024-09-16T07:52:49.627314+0000","last_undegraded":"2024-09-16T07:52:49.627314+0000","last_fullsized":"2024-09-16T07:52:49.627314+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1d","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.614967+0000","last_change":"2024-09-16T07:38:56.550793+0000","last_active":"2024-09-16T07:52:49.614967+0000","last_peered":"2024-09-16T07:52:49.614967+0000","last_clean":"2024-09-16T07:52:49.614967+0000","last_became_active":"2024-09-16T07:38:56.543879+0000","last_became_peered":"2024-09-16T07:38:56.543879+0000","last_unstale":"2024-09-16T07:52:49.614967+0000","last_undegraded":"2024-09-16T07:52:49.614967+0000","last_fullsized":"2024-09-16T07:52:49.614967+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.1c","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.600522+0000","last_change":"2024-09-16T07:38:56.599574+0000","last_active":"2024-09-16T07:52:49.600522+0000","last_peered":"2024-09-16T07:52:49.600522+0000","last_clean":"2024-09-16T07:52:49.600522+0000","last_became_active":"2024-09-16T07:38:56.593078+0000","last_became_peered":"2024-09-16T07:38:56.593078+0000","last_unstale":"2024-09-16T07:52:49.600522+0000","last_undegraded":"2024-09-16T07:52:49.600522+0000","last_fullsized":"2024-09-16T07:52:49.600522+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1b","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.609809+0000","last_change":"2024-09-16T07:38:56.553575+0000","last_active":"2024-09-16T07:52:49.609809+0000","last_peered":"2024-09-16T07:52:49.609809+0000","last_clean":"2024-09-16T07:52:49.609809+0000","last_became_active":"2024-09-16T07:38:56.546684+0000","last_became_peered":"2024-09-16T07:38:56.546684+0000","last_unstale":"2024-09-16T07:52:49.609809+0000","last_undegraded":"2024-09-16T07:52:49.609809+0000","last_fullsized":"2024-09-16T07:52:49.609809+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1a","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.609607+0000","last_change":"2024-09-16T07:38:56.571451+0000","last_active":"2024-09-16T07:52:49.609607+0000","last_peered":"2024-09-16T07:52:49.609607+0000","last_clean":"2024-09-16T07:52:49.609607+0000","last_became_active":"2024-09-16T07:38:56.532518+0000","last_became_peered":"2024-09-16T07:38:56.532518+0000","last_unstale":"2024-09-16T07:52:49.609607+0000","last_undegraded":"2024-09-16T07:52:49.609607+0000","last_fullsized":"2024-09-16T07:52:49.609607+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.19","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.648724+0000","last_change":"2024-09-16T07:38:56.613450+0000","last_active":"2024-09-16T07:52:49.648724+0000","last_peered":"2024-09-16T07:52:49.648724+0000","last_clean":"2024-09-16T07:52:49.648724+0000","last_became_active":"2024-09-16T07:38:56.606292+0000","last_became_peered":"2024-09-16T07:38:56.606292+0000","last_unstale":"2024-09-16T07:52:49.648724+0000","last_undegraded":"2024-09-16T07:52:49.648724+0000","last_fullsized":"2024-09-16T07:52:49.648724+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.18","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.609181+0000","last_change":"2024-09-16T07:38:56.638294+0000","last_active":"2024-09-16T07:52:49.609181+0000","last_peered":"2024-09-16T07:52:49.609181+0000","last_clean":"2024-09-16T07:52:49.609181+0000","last_became_active":"2024-09-16T07:38:56.630903+0000","last_became_peered":"2024-09-16T07:38:56.630903+0000","last_unstale":"2024-09-16T07:52:49.609181+0000","last_undegraded":"2024-09-16T07:52:49.609181+0000","last_fullsized":"2024-09-16T07:52:49.609181+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.17","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.588474+0000","last_change":"2024-09-16T07:38:56.531333+0000","last_active":"2024-09-16T07:52:49.588474+0000","last_peered":"2024-09-16T07:52:49.588474+0000","last_clean":"2024-09-16T07:52:49.588474+0000","last_became_active":"2024-09-16T07:38:56.515359+0000","last_became_peered":"2024-09-16T07:38:56.515359+0000","last_unstale":"2024-09-16T07:52:49.588474+0000","last_undegraded":"2024-09-16T07:52:49.588474+0000","last_fullsized":"2024-09-16T07:52:49.588474+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.16","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.596551+0000","last_change":"2024-09-16T07:38:56.527850+0000","last_active":"2024-09-16T07:52:49.596551+0000","last_peered":"2024-09-16T07:52:49.596551+0000","last_clean":"2024-09-16T07:52:49.596551+0000","last_became_active":"2024-09-16T07:38:56.511359+0000","last_became_peered":"2024-09-16T07:38:56.511359+0000","last_unstale":"2024-09-16T07:52:49.596551+0000","last_undegraded":"2024-09-16T07:52:49.596551+0000","last_fullsized":"2024-09-16T07:52:49.596551+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.15","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.598937+0000","last_change":"2024-09-16T07:38:56.584741+0000","last_active":"2024-09-16T07:52:49.598937+0000","last_peered":"2024-09-16T07:52:49.598937+0000","last_clean":"2024-09-16T07:52:49.598937+0000","last_became_active":"2024-09-16T07:38:56.572269+0000","last_became_peered":"2024-09-16T07:38:56.572269+0000","last_unstale":"2024-09-16T07:52:49.598937+0000","last_undegraded":"2024-09-16T07:52:49.598937+0000","last_fullsized":"2024-09-16T07:52:49.598937+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.14","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.614406+0000","last_change":"2024-09-16T07:38:56.607891+0000","last_active":"2024-09-16T07:52:49.614406+0000","last_peered":"2024-09-16T07:52:49.614406+0000","last_clean":"2024-09-16T07:52:49.614406+0000","last_became_active":"2024-09-16T07:38:56.597598+0000","last_became_peered":"2024-09-16T07:38:56.597598+0000","last_unstale":"2024-09-16T07:52:49.614406+0000","last_undegraded":"2024-09-16T07:52:49.614406+0000","last_fullsized":"2024-09-16T07:52:49.614406+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.13","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.610580+0000","last_change":"2024-09-16T07:38:56.620750+0000","last_active":"2024-09-16T07:52:49.610580+0000","last_peered":"2024-09-16T07:52:49.610580+0000","last_clean":"2024-09-16T07:52:49.610580+0000","last_became_active":"2024-09-16T07:38:56.612776+0000","last_became_peered":"2024-09-16T07:38:56.612776+0000","last_unstale":"2024-09-16T07:52:49.610580+0000","last_undegraded":"2024-09-16T07:52:49.610580+0000","last_fullsized":"2024-09-16T07:52:49.610580+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.12","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.592699+0000","last_change":"2024-09-16T07:38:56.568199+0000","last_active":"2024-09-16T07:52:49.592699+0000","last_peered":"2024-09-16T07:52:49.592699+0000","last_clean":"2024-09-16T07:52:49.592699+0000","last_became_active":"2024-09-16T07:38:56.549760+0000","last_became_peered":"2024-09-16T07:38:56.549760+0000","last_unstale":"2024-09-16T07:52:49.592699+0000","last_undegraded":"2024-09-16T07:52:49.592699+0000","last_fullsized":"2024-09-16T07:52:49.592699+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.11","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.629663+0000","last_change":"2024-09-16T07:38:56.635466+0000","last_active":"2024-09-16T07:52:49.629663+0000","last_peered":"2024-09-16T07:52:49.629663+0000","last_clean":"2024-09-16T07:52:49.629663+0000","last_became_active":"2024-09-16T07:38:56.627154+0000","last_became_peered":"2024-09-16T07:38:56.627154+0000","last_unstale":"2024-09-16T07:52:49.629663+0000","last_undegraded":"2024-09-16T07:52:49.629663+0000","last_fullsized":"2024-09-16T07:52:49.629663+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.10","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.643855+0000","last_change":"2024-09-16T07:38:56.589078+0000","last_active":"2024-09-16T07:52:49.643855+0000","last_peered":"2024-09-16T07:52:49.643855+0000","last_clean":"2024-09-16T07:52:49.643855+0000","last_became_active":"2024-09-16T07:38:56.582737+0000","last_became_peered":"2024-09-16T07:38:56.582737+0000","last_unstale":"2024-09-16T07:52:49.643855+0000","last_undegraded":"2024-09-16T07:52:49.643855+0000","last_fullsized":"2024-09-16T07:52:49.643855+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.f","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.632383+0000","last_change":"2024-09-16T07:38:56.647138+0000","last_active":"2024-09-16T07:52:49.632383+0000","last_peered":"2024-09-16T07:52:49.632383+0000","last_clean":"2024-09-16T07:52:49.632383+0000","last_became_active":"2024-09-16T07:38:56.634586+0000","last_became_peered":"2024-09-16T07:38:56.634586+0000","last_unstale":"2024-09-16T07:52:49.632383+0000","last_undegraded":"2024-09-16T07:52:49.632383+0000","last_fullsized":"2024-09-16T07:52:49.632383+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.e","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.604678+0000","last_change":"2024-09-16T07:38:56.563232+0000","last_active":"2024-09-16T07:52:49.604678+0000","last_peered":"2024-09-16T07:52:49.604678+0000","last_clean":"2024-09-16T07:52:49.604678+0000","last_became_active":"2024-09-16T07:38:56.543232+0000","last_became_peered":"2024-09-16T07:38:56.543232+0000","last_unstale":"2024-09-16T07:52:49.604678+0000","last_undegraded":"2024-09-16T07:52:49.604678+0000","last_fullsized":"2024-09-16T07:52:49.604678+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.d","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.610250+0000","last_change":"2024-09-16T07:38:56.548184+0000","last_active":"2024-09-16T07:52:49.610250+0000","last_peered":"2024-09-16T07:52:49.610250+0000","last_clean":"2024-09-16T07:52:49.610250+0000","last_became_active":"2024-09-16T07:38:56.537998+0000","last_became_peered":"2024-09-16T07:38:56.537998+0000","last_unstale":"2024-09-16T07:52:49.610250+0000","last_undegraded":"2024-09-16T07:52:49.610250+0000","last_fullsized":"2024-09-16T07:52:49.610250+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.c","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.626062+0000","last_change":"2024-09-16T07:38:56.600064+0000","last_active":"2024-09-16T07:52:49.626062+0000","last_peered":"2024-09-16T07:52:49.626062+0000","last_clean":"2024-09-16T07:52:49.626062+0000","last_became_active":"2024-09-16T07:38:56.587813+0000","last_became_peered":"2024-09-16T07:38:56.587813+0000","last_unstale":"2024-09-16T07:52:49.626062+0000","last_undegraded":"2024-09-16T07:52:49.626062+0000","last_fullsized":"2024-09-16T07:52:49.626062+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.b","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.617512+0000","last_change":"2024-09-16T07:38:56.605067+0000","last_active":"2024-09-16T07:52:49.617512+0000","last_peered":"2024-09-16T07:52:49.617512+0000","last_clean":"2024-09-16T07:52:49.617512+0000","last_became_active":"2024-09-16T07:38:56.593974+0000","last_became_peered":"2024-09-16T07:38:56.593974+0000","last_unstale":"2024-09-16T07:52:49.617512+0000","last_undegraded":"2024-09-16T07:52:49.617512+0000","last_fullsized":"2024-09-16T07:52:49.617512+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.a","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.595209+0000","last_change":"2024-09-16T07:38:56.536096+0000","last_active":"2024-09-16T07:52:49.595209+0000","last_peered":"2024-09-16T07:52:49.595209+0000","last_clean":"2024-09-16T07:52:49.595209+0000","last_became_active":"2024-09-16T07:38:56.523092+0000","last_became_peered":"2024-09-16T07:38:56.523092+0000","last_unstale":"2024-09-16T07:52:49.595209+0000","last_undegraded":"2024-09-16T07:52:49.595209+0000","last_fullsized":"2024-09-16T07:52:49.595209+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.9","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.611132+0000","last_change":"2024-09-16T07:38:56.552526+0000","last_active":"2024-09-16T07:52:49.611132+0000","last_peered":"2024-09-16T07:52:49.611132+0000","last_clean":"2024-09-16T07:52:49.611132+0000","last_became_active":"2024-09-16T07:38:56.545643+0000","last_became_peered":"2024-09-16T07:38:56.545643+0000","last_unstale":"2024-09-16T07:52:49.611132+0000","last_undegraded":"2024-09-16T07:52:49.611132+0000","last_fullsized":"2024-09-16T07:52:49.611132+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.8","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.609807+0000","last_change":"2024-09-16T07:38:56.657793+0000","last_active":"2024-09-16T07:52:49.609807+0000","last_peered":"2024-09-16T07:52:49.609807+0000","last_clean":"2024-09-16T07:52:49.609807+0000","last_became_active":"2024-09-16T07:38:56.651984+0000","last_became_peered":"2024-09-16T07:38:56.651984+0000","last_unstale":"2024-09-16T07:52:49.609807+0000","last_undegraded":"2024-09-16T07:52:49.609807+0000","last_fullsized":"2024-09-16T07:52:49.609807+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.7","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.601048+0000","last_change":"2024-09-16T07:38:56.624485+0000","last_active":"2024-09-16T07:52:49.601048+0000","last_peered":"2024-09-16T07:52:49.601048+0000","last_clean":"2024-09-16T07:52:49.601048+0000","last_became_active":"2024-09-16T07:38:56.616849+0000","last_became_peered":"2024-09-16T07:38:56.616849+0000","last_unstale":"2024-09-16T07:52:49.601048+0000","last_undegraded":"2024-09-16T07:52:49.601048+0000","last_fullsized":"2024-09-16T07:52:49.601048+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.6","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.644671+0000","last_change":"2024-09-16T07:38:56.531334+0000","last_active":"2024-09-16T07:52:49.644671+0000","last_peered":"2024-09-16T07:52:49.644671+0000","last_clean":"2024-09-16T07:52:49.644671+0000","last_became_active":"2024-09-16T07:38:56.520779+0000","last_became_peered":"2024-09-16T07:38:56.520779+0000","last_unstale":"2024-09-16T07:52:49.644671+0000","last_undegraded":"2024-09-16T07:52:49.644671+0000","last_fullsized":"2024-09-16T07:52:49.644671+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.5","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.600706+0000","last_change":"2024-09-16T07:38:56.590139+0000","last_active":"2024-09-16T07:52:49.600706+0000","last_peered":"2024-09-16T07:52:49.600706+0000","last_clean":"2024-09-16T07:52:49.600706+0000","last_became_active":"2024-09-16T07:38:56.578614+0000","last_became_peered":"2024-09-16T07:38:56.578614+0000","last_unstale":"2024-09-16T07:52:49.600706+0000","last_undegraded":"2024-09-16T07:52:49.600706+0000","last_fullsized":"2024-09-16T07:52:49.600706+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.4","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.628056+0000","last_change":"2024-09-16T07:38:56.684296+0000","last_active":"2024-09-16T07:52:49.628056+0000","last_peered":"2024-09-16T07:52:49.628056+0000","last_clean":"2024-09-16T07:52:49.628056+0000","last_became_active":"2024-09-16T07:38:56.678986+0000","last_became_peered":"2024-09-16T07:38:56.678986+0000","last_unstale":"2024-09-16T07:52:49.628056+0000","last_undegraded":"2024-09-16T07:52:49.628056+0000","last_fullsized":"2024-09-16T07:52:49.628056+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.3","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.623271+0000","last_change":"2024-09-16T07:38:56.574269+0000","last_active":"2024-09-16T07:52:49.623271+0000","last_peered":"2024-09-16T07:52:49.623271+0000","last_clean":"2024-09-16T07:52:49.623271+0000","last_became_active":"2024-09-16T07:38:56.558143+0000","last_became_peered":"2024-09-16T07:38:56.558143+0000","last_unstale":"2024-09-16T07:52:49.623271+0000","last_undegraded":"2024-09-16T07:52:49.623271+0000","last_fullsized":"2024-09-16T07:52:49.623271+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.2","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.611405+0000","last_change":"2024-09-16T07:38:56.563501+0000","last_active":"2024-09-16T07:52:49.611405+0000","last_peered":"2024-09-16T07:52:49.611405+0000","last_clean":"2024-09-16T07:52:49.611405+0000","last_became_active":"2024-09-16T07:38:56.539784+0000","last_became_peered":"2024-09-16T07:38:56.539784+0000","last_unstale":"2024-09-16T07:52:49.611405+0000","last_undegraded":"2024-09-16T07:52:49.611405+0000","last_fullsized":"2024-09-16T07:52:49.611405+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1","version":"239'7","reported_seq":1470,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.607080+0000","last_change":"2024-09-16T07:38:56.532354+0000","last_active":"2024-09-16T07:52:49.607080+0000","last_peered":"2024-09-16T07:52:49.607080+0000","last_clean":"2024-09-16T07:52:49.607080+0000","last_became_active":"2024-09-16T07:38:56.517409+0000","last_became_peered":"2024-09-16T07:38:56.517409+0000","last_unstale":"2024-09-16T07:52:49.607080+0000","last_undegraded":"2024-09-16T07:52:49.607080+0000","last_fullsized":"2024-09-16T07:52:49.607080+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.0","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.613719+0000","last_change":"2024-09-16T07:38:56.506449+0000","last_active":"2024-09-16T07:52:49.613719+0000","last_peered":"2024-09-16T07:52:49.613719+0000","last_clean":"2024-09-16T07:52:49.613719+0000","last_became_active":"2024-09-16T07:38:56.499378+0000","last_became_peered":"2024-09-16T07:38:56.499378+0000","last_unstale":"2024-09-16T07:52:49.613719+0000","last_undegraded":"2024-09-16T07:52:49.613719+0000","last_fullsized":"2024-09-16T07:52:49.613719+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":2136,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.598810+0000","last_change":"2024-09-16T07:33:55.962652+0000","last_active":"2024-09-16T07:52:49.598810+0000","last_peered":"2024-09-16T07:52:49.598810+0000","last_clean":"2024-09-16T07:52:49.598810+0000","last_became_active":"2024-09-16T07:33:53.988604+0000","last_became_peered":"2024-09-16T07:33:53.988604+0000","last_unstale":"2024-09-16T07:52:49.598810+0000","last_undegraded":"2024-09-16T07:52:49.598810+0000","last_fullsized":"2024-09-16T07:52:49.598810+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_clean_scrub_stamp":"2024-09-16T07:33:52.925999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":2136,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.609334+0000","last_change":"2024-09-16T07:33:55.963562+0000","last_active":"2024-09-16T07:52:49.609334+0000","last_peered":"2024-09-16T07:52:49.609334+0000","last_clean":"2024-09-16T07:52:49.609334+0000","last_became_active":"2024-09-16T07:33:53.999244+0000","last_became_peered":"2024-09-16T07:33:53.999244+0000","last_unstale":"2024-09-16T07:52:49.609334+0000","last_undegraded":"2024-09-16T07:52:49.609334+0000","last_fullsized":"2024-09-16T07:52:49.609334+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_clean_scrub_stamp":"2024-09-16T07:33:52.925999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":2136,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.602588+0000","last_change":"2024-09-16T07:33:55.964565+0000","last_active":"2024-09-16T07:52:49.602588+0000","last_peered":"2024-09-16T07:52:49.602588+0000","last_clean":"2024-09-16T07:52:49.602588+0000","last_became_active":"2024-09-16T07:33:54.001528+0000","last_became_peered":"2024-09-16T07:33:54.001528+0000","last_unstale":"2024-09-16T07:52:49.602588+0000","last_undegraded":"2024-09-16T07:52:49.602588+0000","last_fullsized":"2024-09-16T07:52:49.602588+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_clean_scrub_stamp":"2024-09-16T07:33:52.925999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":2136,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.600990+0000","last_change":"2024-09-16T07:33:55.961854+0000","last_active":"2024-09-16T07:52:49.600990+0000","last_peered":"2024-09-16T07:52:49.600990+0000","last_clean":"2024-09-16T07:52:49.600990+0000","last_became_active":"2024-09-16T07:33:53.989047+0000","last_became_peered":"2024-09-16T07:33:53.989047+0000","last_unstale":"2024-09-16T07:52:49.600990+0000","last_undegraded":"2024-09-16T07:52:49.600990+0000","last_fullsized":"2024-09-16T07:52:49.600990+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_clean_scrub_stamp":"2024-09-16T07:33:52.925999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":2138,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.639851+0000","last_change":"2024-09-16T07:33:55.962135+0000","last_active":"2024-09-16T07:52:49.639851+0000","last_peered":"2024-09-16T07:52:49.639851+0000","last_clean":"2024-09-16T07:52:49.639851+0000","last_became_active":"2024-09-16T07:33:53.989661+0000","last_became_peered":"2024-09-16T07:33:53.989661+0000","last_unstale":"2024-09-16T07:52:49.639851+0000","last_undegraded":"2024-09-16T07:52:49.639851+0000","last_fullsized":"2024-09-16T07:52:49.639851+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_clean_scrub_stamp":"2024-09-16T07:33:52.925999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":2136,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.592683+0000","last_change":"2024-09-16T07:33:55.962959+0000","last_active":"2024-09-16T07:52:49.592683+0000","last_peered":"2024-09-16T07:52:49.592683+0000","last_clean":"2024-09-16T07:52:49.592683+0000","last_became_active":"2024-09-16T07:33:54.001165+0000","last_became_peered":"2024-09-16T07:33:54.001165+0000","last_unstale":"2024-09-16T07:52:49.592683+0000","last_undegraded":"2024-09-16T07:52:49.592683+0000","last_fullsized":"2024-09-16T07:52:49.592683+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_clean_scrub_stamp":"2024-09-16T07:33:52.925999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":2136,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.611341+0000","last_change":"2024-09-16T07:33:55.962311+0000","last_active":"2024-09-16T07:52:49.611341+0000","last_peered":"2024-09-16T07:52:49.611341+0000","last_clean":"2024-09-16T07:52:49.611341+0000","last_became_active":"2024-09-16T07:33:53.998493+0000","last_became_peered":"2024-09-16T07:33:53.998493+0000","last_unstale":"2024-09-16T07:52:49.611341+0000","last_undegraded":"2024-09-16T07:52:49.611341+0000","last_fullsized":"2024-09-16T07:52:49.611341+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_clean_scrub_stamp":"2024-09-16T07:33:52.925999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":2137,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.606316+0000","last_change":"2024-09-16T07:33:55.965013+0000","last_active":"2024-09-16T07:52:49.606316+0000","last_peered":"2024-09-16T07:52:49.606316+0000","last_clean":"2024-09-16T07:52:49.606316+0000","last_became_active":"2024-09-16T07:33:54.007370+0000","last_became_peered":"2024-09-16T07:33:54.007370+0000","last_unstale":"2024-09-16T07:52:49.606316+0000","last_undegraded":"2024-09-16T07:52:49.606316+0000","last_fullsized":"2024-09-16T07:52:49.606316+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_clean_scrub_stamp":"2024-09-16T07:33:52.925999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":2208,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.598687+0000","last_change":"2024-09-16T07:33:51.972549+0000","last_active":"2024-09-16T07:52:49.598687+0000","last_peered":"2024-09-16T07:52:49.598687+0000","last_clean":"2024-09-16T07:52:49.598687+0000","last_became_active":"2024-09-16T07:33:51.963446+0000","last_became_peered":"2024-09-16T07:33:51.963446+0000","last_unstale":"2024-09-16T07:52:49.598687+0000","last_undegraded":"2024-09-16T07:52:49.598687+0000","last_fullsized":"2024-09-16T07:52:49.598687+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:50.923539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:50.923539+0000","last_clean_scrub_stamp":"2024-09-16T07:33:50.923539+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":75,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30044,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":63300,"kb_used_data":1780,"kb_used_omap":0,"kb_used_meta":61504,"kb_avail":94308540,"statfs":{"total":96636764160,"available":96571944960,"internally_reserved":0,"allocated":1822720,"data_stored":1158276,"data_compressed":59484,"data_compressed_allocated":81920,"data_compressed_original":634880,"omap_allocated":0,"internal_metadata":62980096},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":64668,"kb_used_data":1740,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94307172,"statfs":{"total":96636764160,"available":96570544128,"internally_reserved":0,"allocated":1781760,"data_stored":580807,"data_compressed":35328,"data_compressed_allocated":49152,"data_compressed_original":73728,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59084,"kb_used_data":1724,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94312756,"statfs":{"total":96636764160,"available":96576262144,"internally_reserved":0,"allocated":1765376,"data_stored":567913,"data_compressed":29440,"data_compressed_allocated":40960,"data_compressed_original":61440,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":68884,"kb_used_data":1796,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94302956,"statfs":{"total":96636764160,"available":96566226944,"internally_reserved":0,"allocated":1839104,"data_stored":1171170,"data_compressed":65372,"data_compressed_allocated":90112,"data_compressed_original":647168,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30044,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:52:55.701 INFO:tasks.ceph:pgid 75.1f last_scrub_stamp 2024-09-16T07:38:55.399381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=38, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:52:55.701 INFO:tasks.ceph:pgid 75.1e last_scrub_stamp 2024-09-16T07:38:55.399381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=38, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:52:55.701 INFO:tasks.ceph:pgid 75.1d last_scrub_stamp 2024-09-16T07:38:55.399381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=38, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:52:55.701 INFO:tasks.ceph:pgid 75.1c last_scrub_stamp 2024-09-16T07:38:55.399381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=38, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:52:55.701 INFO:tasks.ceph:pgid 75.1b last_scrub_stamp 2024-09-16T07:38:55.399381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=38, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:52:55.701 INFO:tasks.ceph:pgid 75.1a last_scrub_stamp 2024-09-16T07:38:55.399381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=38, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:52:55.701 INFO:tasks.ceph:pgid 75.19 last_scrub_stamp 2024-09-16T07:38:55.399381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=38, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:52:55.702 INFO:tasks.ceph:pgid 75.18 last_scrub_stamp 2024-09-16T07:38:55.399381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=38, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:52:55.702 INFO:tasks.ceph:pgid 75.17 last_scrub_stamp 2024-09-16T07:38:55.399381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=38, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:52:55.702 INFO:tasks.ceph:pgid 75.16 last_scrub_stamp 2024-09-16T07:38:55.399381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=38, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:52:55.702 INFO:tasks.ceph:pgid 75.15 last_scrub_stamp 2024-09-16T07:38:55.399381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=38, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:52:55.702 INFO:tasks.ceph:pgid 75.14 last_scrub_stamp 2024-09-16T07:38:55.399381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=38, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:52:55.702 INFO:tasks.ceph:pgid 75.13 last_scrub_stamp 2024-09-16T07:38:55.399381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=38, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:52:55.702 INFO:tasks.ceph:pgid 75.12 last_scrub_stamp 2024-09-16T07:38:55.399381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=38, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:52:55.702 INFO:tasks.ceph:pgid 75.11 last_scrub_stamp 2024-09-16T07:38:55.399381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=38, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:52:55.702 INFO:tasks.ceph:pgid 75.10 last_scrub_stamp 2024-09-16T07:38:55.399381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=38, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:52:55.703 INFO:tasks.ceph:pgid 75.f last_scrub_stamp 2024-09-16T07:38:55.399381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=38, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:52:55.703 INFO:tasks.ceph:pgid 75.e last_scrub_stamp 2024-09-16T07:38:55.399381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=38, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:52:55.703 INFO:tasks.ceph:pgid 75.d last_scrub_stamp 2024-09-16T07:38:55.399381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=38, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:52:55.703 INFO:tasks.ceph:pgid 75.c last_scrub_stamp 2024-09-16T07:38:55.399381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=38, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:52:55.703 INFO:tasks.ceph:pgid 75.b last_scrub_stamp 2024-09-16T07:38:55.399381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=38, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:52:55.703 INFO:tasks.ceph:pgid 75.a last_scrub_stamp 2024-09-16T07:38:55.399381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=38, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:52:55.703 INFO:tasks.ceph:pgid 75.9 last_scrub_stamp 2024-09-16T07:38:55.399381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=38, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:52:55.703 INFO:tasks.ceph:pgid 75.8 last_scrub_stamp 2024-09-16T07:38:55.399381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=38, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:52:55.703 INFO:tasks.ceph:pgid 75.7 last_scrub_stamp 2024-09-16T07:38:55.399381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=38, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:52:55.703 INFO:tasks.ceph:pgid 75.6 last_scrub_stamp 2024-09-16T07:38:55.399381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=38, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:52:55.704 INFO:tasks.ceph:pgid 75.5 last_scrub_stamp 2024-09-16T07:38:55.399381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=38, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:52:55.704 INFO:tasks.ceph:pgid 75.4 last_scrub_stamp 2024-09-16T07:38:55.399381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=38, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:52:55.704 INFO:tasks.ceph:pgid 75.3 last_scrub_stamp 2024-09-16T07:38:55.399381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=38, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:52:55.704 INFO:tasks.ceph:pgid 75.2 last_scrub_stamp 2024-09-16T07:38:55.399381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=38, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:52:55.704 INFO:tasks.ceph:pgid 75.1 last_scrub_stamp 2024-09-16T07:38:55.399381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=38, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:52:55.704 INFO:tasks.ceph:pgid 75.0 last_scrub_stamp 2024-09-16T07:38:55.399381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=38, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:52:55.704 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-16T07:33:52.925999+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=33, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:52:55.704 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-16T07:33:52.925999+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=33, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:52:55.704 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-16T07:33:52.925999+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=33, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:52:55.705 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-16T07:33:52.925999+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=33, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:52:55.705 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-16T07:33:52.925999+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=33, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:52:55.705 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-16T07:33:52.925999+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=33, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:52:55.705 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-16T07:33:52.925999+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=33, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:52:55.705 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-16T07:33:52.925999+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=33, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:52:55.705 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-16T07:33:50.923539+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=33, tm_sec=50, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:52:55.705 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T07:53:15.706 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:53:15.828 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:15.825+0000 7f34f38fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:15.829 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:15.830+0000 7f34f38fd640 1 Processor -- start 2024-09-16T07:53:15.829 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:15.830+0000 7f34f38fd640 1 -- start start 2024-09-16T07:53:15.831 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:15.831+0000 7f34f38fd640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f34ec09af30 0x7f34ec133fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:53:15.831 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:15.831+0000 7f34f38fd640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34ec09d410 con 0x7f34ec1344e0 2024-09-16T07:53:15.831 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:15.831+0000 7f34f38fd640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f34ec133cd0 con 0x7f34ec09af30 2024-09-16T07:53:15.831 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:15.832+0000 7f34f1699640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f34ec09af30 0x7f34ec133fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:53:15.831 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:15.832+0000 7f34f1699640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f34ec09af30 0x7f34ec133fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60562/0 (socket says 172.21.15.121:60562) 2024-09-16T07:53:15.831 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:15.832+0000 7f34f0e98640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f34ec1344e0 0x7f34ec130630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:53146/0 (socket says 172.21.15.121:53146) 2024-09-16T07:53:15.831 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:15.832+0000 7f34f1699640 1 -- 172.21.15.121:0/3484658961 learned_addr learned my addr 172.21.15.121:0/3484658961 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:53:15.831 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:15.832+0000 7f34f1699640 1 -- 172.21.15.121:0/3484658961 >> v1:172.21.15.121:6789/0 conn(0x7f34ec1344e0 legacy=0x7f34ec130630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:53:15.831 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:15.832+0000 7f34f1699640 1 -- 172.21.15.121:0/3484658961 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34ec09a930 con 0x7f34ec09af30 2024-09-16T07:53:15.832 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:15.832+0000 7f34f1699640 1 --2- 172.21.15.121:0/3484658961 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f34ec09af30 0x7f34ec133fa0 crc :-1 s=READY pgs=13032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24cdb8e66915cd88 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:53:15.832 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:15.832+0000 7f34ebfff640 1 -- 172.21.15.121:0/3484658961 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f34e4009e50 con 0x7f34ec09af30 2024-09-16T07:53:15.832 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:15.832+0000 7f34ebfff640 1 -- 172.21.15.121:0/3484658961 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f34e400e230 con 0x7f34ec09af30 2024-09-16T07:53:15.832 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:15.832+0000 7f34ebfff640 1 -- 172.21.15.121:0/3484658961 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f34e400e4d0 con 0x7f34ec09af30 2024-09-16T07:53:15.833 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:15.833+0000 7f34f38fd640 1 -- 172.21.15.121:0/3484658961 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f34ec09af30 msgr2=0x7f34ec133fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:53:15.833 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:15.833+0000 7f34f38fd640 1 --2- 172.21.15.121:0/3484658961 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f34ec09af30 0x7f34ec133fa0 crc :-1 s=READY pgs=13032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:53:15.833 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:15.833+0000 7f34f38fd640 1 -- 172.21.15.121:0/3484658961 shutdown_connections 2024-09-16T07:53:15.833 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:15.833+0000 7f34f38fd640 1 --2- 172.21.15.121:0/3484658961 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f34ec09af30 0x7f34ec133fa0 unknown :-1 s=CLOSED pgs=13032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:53:15.833 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:15.833+0000 7f34f38fd640 1 -- 172.21.15.121:0/3484658961 >> 172.21.15.121:0/3484658961 conn(0x7f34ec0a11f0 msgr2=0x7f34ec0a1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:53:15.833 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:15.833+0000 7f34f38fd640 1 -- 172.21.15.121:0/3484658961 shutdown_connections 2024-09-16T07:53:15.833 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:15.833+0000 7f34f38fd640 1 -- 172.21.15.121:0/3484658961 wait complete. 2024-09-16T07:53:15.833 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:15.833+0000 7f34f38fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:15.834 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:15.835+0000 7f34f38fd640 1 Processor -- start 2024-09-16T07:53:15.834 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:15.835+0000 7f34f38fd640 1 -- start start 2024-09-16T07:53:15.835 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:15.836+0000 7f34f38fd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f34ec09af30 0x7f34ec1cacd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:53:15.835 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:15.836+0000 7f34f38fd640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f34ec099c30 con 0x7f34ec09af30 2024-09-16T07:53:15.835 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:15.836+0000 7f34f1699640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f34ec09af30 0x7f34ec1cacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:53:15.835 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:15.836+0000 7f34f1699640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f34ec09af30 0x7f34ec1cacd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60578/0 (socket says 172.21.15.121:60578) 2024-09-16T07:53:15.836 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:15.836+0000 7f34f1699640 1 -- 172.21.15.121:0/1954200355 learned_addr learned my addr 172.21.15.121:0/1954200355 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:53:15.836 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:15.836+0000 7f34f1699640 1 -- 172.21.15.121:0/1954200355 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34ec12fdd0 con 0x7f34ec09af30 2024-09-16T07:53:15.836 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:15.836+0000 7f34f1699640 1 --2- 172.21.15.121:0/1954200355 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f34ec09af30 0x7f34ec1cacd0 crc :-1 s=READY pgs=13033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:53:15.836 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:15.836+0000 7f34e9ffb640 1 -- 172.21.15.121:0/1954200355 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f34e400ede0 con 0x7f34ec09af30 2024-09-16T07:53:15.836 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:15.836+0000 7f34e9ffb640 1 -- 172.21.15.121:0/1954200355 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f34e4015420 con 0x7f34ec09af30 2024-09-16T07:53:15.836 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:15.836+0000 7f34e9ffb640 1 -- 172.21.15.121:0/1954200355 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f34e40156c0 con 0x7f34ec09af30 2024-09-16T07:53:15.836 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:15.837+0000 7f34f38fd640 1 -- 172.21.15.121:0/1954200355 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34ec130070 con 0x7f34ec09af30 2024-09-16T07:53:15.836 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:15.837+0000 7f34f38fd640 1 -- 172.21.15.121:0/1954200355 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34ec12ee80 con 0x7f34ec09af30 2024-09-16T07:53:15.837 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:15.838+0000 7f34e9ffb640 1 -- 172.21.15.121:0/1954200355 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f34e4015870 con 0x7f34ec09af30 2024-09-16T07:53:15.837 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:15.838+0000 7f34f38fd640 1 -- 172.21.15.121:0/1954200355 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34ec130cc0 con 0x7f34ec09af30 2024-09-16T07:53:15.837 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:15.838+0000 7f34e9ffb640 1 --2- 172.21.15.121:0/1954200355 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f34d803e930 0x7f34d8040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:53:15.837 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:15.838+0000 7f34e9ffb640 1 -- 172.21.15.121:0/1954200355 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(723..723 src has 620..723) ==== 3431+0+0 (crc 0 0 0) 0x7f34e4050f20 con 0x7f34ec09af30 2024-09-16T07:53:15.837 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:15.838+0000 7f34f0e98640 1 --2- 172.21.15.121:0/1954200355 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f34d803e930 0x7f34d8040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:53:15.837 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:15.839+0000 7f34f0e98640 1 --2- 172.21.15.121:0/1954200355 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f34d803e930 0x7f34d8040e40 crc :-1 s=READY pgs=3857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:53:15.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:15.843+0000 7f34e9ffb640 1 -- 172.21.15.121:0/1954200355 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f34e400f2a0 con 0x7f34ec09af30 2024-09-16T07:53:16.014 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:16.015+0000 7f34f38fd640 1 -- 172.21.15.121:0/1954200355 --> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f34ec12fa20 con 0x7f34d803e930 2024-09-16T07:53:16.017 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:16.019+0000 7f34e9ffb640 1 -- 172.21.15.121:0/1954200355 <== mgr.4102 v2:172.21.15.172:6800/643901738 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+109213 (crc 0 0 0) 0x7f34ec12fa20 con 0x7f34d803e930 2024-09-16T07:53:16.019 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:53:16.020 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-09-16T07:53:16.023 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:16.021+0000 7f34f38fd640 1 -- 172.21.15.121:0/1954200355 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f34d803e930 msgr2=0x7f34d8040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:53:16.023 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:16.021+0000 7f34f38fd640 1 --2- 172.21.15.121:0/1954200355 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f34d803e930 0x7f34d8040e40 crc :-1 s=READY pgs=3857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:53:16.023 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:16.021+0000 7f34f38fd640 1 -- 172.21.15.121:0/1954200355 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f34ec09af30 msgr2=0x7f34ec1cacd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:53:16.023 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:16.021+0000 7f34f38fd640 1 --2- 172.21.15.121:0/1954200355 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f34ec09af30 0x7f34ec1cacd0 crc :-1 s=READY pgs=13033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:53:16.023 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:16.021+0000 7f34f38fd640 1 -- 172.21.15.121:0/1954200355 shutdown_connections 2024-09-16T07:53:16.024 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:16.021+0000 7f34f38fd640 1 --2- 172.21.15.121:0/1954200355 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f34d803e930 0x7f34d8040e40 unknown :-1 s=CLOSED pgs=3857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:53:16.024 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:16.021+0000 7f34f38fd640 1 --2- 172.21.15.121:0/1954200355 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f34ec09af30 0x7f34ec1cacd0 unknown :-1 s=CLOSED pgs=13033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:53:16.024 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:16.021+0000 7f34f38fd640 1 -- 172.21.15.121:0/1954200355 >> 172.21.15.121:0/1954200355 conn(0x7f34ec0a11f0 msgr2=0x7f34ec0a36d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:53:16.024 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:16.021+0000 7f34f38fd640 1 -- 172.21.15.121:0/1954200355 shutdown_connections 2024-09-16T07:53:16.024 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:16.021+0000 7f34f38fd640 1 -- 172.21.15.121:0/1954200355 wait complete. 2024-09-16T07:53:16.031 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":1298,"stamp":"2024-09-16T07:53:15.135133+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590392,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":52,"num_write":88,"num_write_kb":1115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":62,"ondisk_log_size":62,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":255936,"kb_used_data":7040,"kb_used_omap":0,"kb_used_meta":248832,"kb_avail":377231424,"statfs":{"total":386547056640,"available":386284978176,"internally_reserved":0,"allocated":7208960,"data_stored":3478166,"data_compressed":189624,"data_compressed_allocated":262144,"data_compressed_original":1417216,"omap_allocated":0,"internal_metadata":254803968},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003215"},"pg_stats":[{"pgid":"75.1f","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.604966+0000","last_change":"2024-09-16T07:38:56.550066+0000","last_active":"2024-09-16T07:52:49.604966+0000","last_peered":"2024-09-16T07:52:49.604966+0000","last_clean":"2024-09-16T07:52:49.604966+0000","last_became_active":"2024-09-16T07:38:56.541997+0000","last_became_peered":"2024-09-16T07:38:56.541997+0000","last_unstale":"2024-09-16T07:52:49.604966+0000","last_undegraded":"2024-09-16T07:52:49.604966+0000","last_fullsized":"2024-09-16T07:52:49.604966+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1e","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.627314+0000","last_change":"2024-09-16T07:38:56.566272+0000","last_active":"2024-09-16T07:52:49.627314+0000","last_peered":"2024-09-16T07:52:49.627314+0000","last_clean":"2024-09-16T07:52:49.627314+0000","last_became_active":"2024-09-16T07:38:56.548814+0000","last_became_peered":"2024-09-16T07:38:56.548814+0000","last_unstale":"2024-09-16T07:52:49.627314+0000","last_undegraded":"2024-09-16T07:52:49.627314+0000","last_fullsized":"2024-09-16T07:52:49.627314+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1d","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.614967+0000","last_change":"2024-09-16T07:38:56.550793+0000","last_active":"2024-09-16T07:52:49.614967+0000","last_peered":"2024-09-16T07:52:49.614967+0000","last_clean":"2024-09-16T07:52:49.614967+0000","last_became_active":"2024-09-16T07:38:56.543879+0000","last_became_peered":"2024-09-16T07:38:56.543879+0000","last_unstale":"2024-09-16T07:52:49.614967+0000","last_undegraded":"2024-09-16T07:52:49.614967+0000","last_fullsized":"2024-09-16T07:52:49.614967+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.1c","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.600522+0000","last_change":"2024-09-16T07:38:56.599574+0000","last_active":"2024-09-16T07:52:49.600522+0000","last_peered":"2024-09-16T07:52:49.600522+0000","last_clean":"2024-09-16T07:52:49.600522+0000","last_became_active":"2024-09-16T07:38:56.593078+0000","last_became_peered":"2024-09-16T07:38:56.593078+0000","last_unstale":"2024-09-16T07:52:49.600522+0000","last_undegraded":"2024-09-16T07:52:49.600522+0000","last_fullsized":"2024-09-16T07:52:49.600522+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1b","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.609809+0000","last_change":"2024-09-16T07:38:56.553575+0000","last_active":"2024-09-16T07:52:49.609809+0000","last_peered":"2024-09-16T07:52:49.609809+0000","last_clean":"2024-09-16T07:52:49.609809+0000","last_became_active":"2024-09-16T07:38:56.546684+0000","last_became_peered":"2024-09-16T07:38:56.546684+0000","last_unstale":"2024-09-16T07:52:49.609809+0000","last_undegraded":"2024-09-16T07:52:49.609809+0000","last_fullsized":"2024-09-16T07:52:49.609809+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1a","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.609607+0000","last_change":"2024-09-16T07:38:56.571451+0000","last_active":"2024-09-16T07:52:49.609607+0000","last_peered":"2024-09-16T07:52:49.609607+0000","last_clean":"2024-09-16T07:52:49.609607+0000","last_became_active":"2024-09-16T07:38:56.532518+0000","last_became_peered":"2024-09-16T07:38:56.532518+0000","last_unstale":"2024-09-16T07:52:49.609607+0000","last_undegraded":"2024-09-16T07:52:49.609607+0000","last_fullsized":"2024-09-16T07:52:49.609607+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.19","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.648724+0000","last_change":"2024-09-16T07:38:56.613450+0000","last_active":"2024-09-16T07:52:49.648724+0000","last_peered":"2024-09-16T07:52:49.648724+0000","last_clean":"2024-09-16T07:52:49.648724+0000","last_became_active":"2024-09-16T07:38:56.606292+0000","last_became_peered":"2024-09-16T07:38:56.606292+0000","last_unstale":"2024-09-16T07:52:49.648724+0000","last_undegraded":"2024-09-16T07:52:49.648724+0000","last_fullsized":"2024-09-16T07:52:49.648724+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.18","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.609181+0000","last_change":"2024-09-16T07:38:56.638294+0000","last_active":"2024-09-16T07:52:49.609181+0000","last_peered":"2024-09-16T07:52:49.609181+0000","last_clean":"2024-09-16T07:52:49.609181+0000","last_became_active":"2024-09-16T07:38:56.630903+0000","last_became_peered":"2024-09-16T07:38:56.630903+0000","last_unstale":"2024-09-16T07:52:49.609181+0000","last_undegraded":"2024-09-16T07:52:49.609181+0000","last_fullsized":"2024-09-16T07:52:49.609181+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.17","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.588474+0000","last_change":"2024-09-16T07:38:56.531333+0000","last_active":"2024-09-16T07:52:49.588474+0000","last_peered":"2024-09-16T07:52:49.588474+0000","last_clean":"2024-09-16T07:52:49.588474+0000","last_became_active":"2024-09-16T07:38:56.515359+0000","last_became_peered":"2024-09-16T07:38:56.515359+0000","last_unstale":"2024-09-16T07:52:49.588474+0000","last_undegraded":"2024-09-16T07:52:49.588474+0000","last_fullsized":"2024-09-16T07:52:49.588474+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.16","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.596551+0000","last_change":"2024-09-16T07:38:56.527850+0000","last_active":"2024-09-16T07:52:49.596551+0000","last_peered":"2024-09-16T07:52:49.596551+0000","last_clean":"2024-09-16T07:52:49.596551+0000","last_became_active":"2024-09-16T07:38:56.511359+0000","last_became_peered":"2024-09-16T07:38:56.511359+0000","last_unstale":"2024-09-16T07:52:49.596551+0000","last_undegraded":"2024-09-16T07:52:49.596551+0000","last_fullsized":"2024-09-16T07:52:49.596551+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.15","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.598937+0000","last_change":"2024-09-16T07:38:56.584741+0000","last_active":"2024-09-16T07:52:49.598937+0000","last_peered":"2024-09-16T07:52:49.598937+0000","last_clean":"2024-09-16T07:52:49.598937+0000","last_became_active":"2024-09-16T07:38:56.572269+0000","last_became_peered":"2024-09-16T07:38:56.572269+0000","last_unstale":"2024-09-16T07:52:49.598937+0000","last_undegraded":"2024-09-16T07:52:49.598937+0000","last_fullsized":"2024-09-16T07:52:49.598937+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.14","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.614406+0000","last_change":"2024-09-16T07:38:56.607891+0000","last_active":"2024-09-16T07:52:49.614406+0000","last_peered":"2024-09-16T07:52:49.614406+0000","last_clean":"2024-09-16T07:52:49.614406+0000","last_became_active":"2024-09-16T07:38:56.597598+0000","last_became_peered":"2024-09-16T07:38:56.597598+0000","last_unstale":"2024-09-16T07:52:49.614406+0000","last_undegraded":"2024-09-16T07:52:49.614406+0000","last_fullsized":"2024-09-16T07:52:49.614406+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.13","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.610580+0000","last_change":"2024-09-16T07:38:56.620750+0000","last_active":"2024-09-16T07:52:49.610580+0000","last_peered":"2024-09-16T07:52:49.610580+0000","last_clean":"2024-09-16T07:52:49.610580+0000","last_became_active":"2024-09-16T07:38:56.612776+0000","last_became_peered":"2024-09-16T07:38:56.612776+0000","last_unstale":"2024-09-16T07:52:49.610580+0000","last_undegraded":"2024-09-16T07:52:49.610580+0000","last_fullsized":"2024-09-16T07:52:49.610580+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.12","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.592699+0000","last_change":"2024-09-16T07:38:56.568199+0000","last_active":"2024-09-16T07:52:49.592699+0000","last_peered":"2024-09-16T07:52:49.592699+0000","last_clean":"2024-09-16T07:52:49.592699+0000","last_became_active":"2024-09-16T07:38:56.549760+0000","last_became_peered":"2024-09-16T07:38:56.549760+0000","last_unstale":"2024-09-16T07:52:49.592699+0000","last_undegraded":"2024-09-16T07:52:49.592699+0000","last_fullsized":"2024-09-16T07:52:49.592699+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.11","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.629663+0000","last_change":"2024-09-16T07:38:56.635466+0000","last_active":"2024-09-16T07:52:49.629663+0000","last_peered":"2024-09-16T07:52:49.629663+0000","last_clean":"2024-09-16T07:52:49.629663+0000","last_became_active":"2024-09-16T07:38:56.627154+0000","last_became_peered":"2024-09-16T07:38:56.627154+0000","last_unstale":"2024-09-16T07:52:49.629663+0000","last_undegraded":"2024-09-16T07:52:49.629663+0000","last_fullsized":"2024-09-16T07:52:49.629663+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.10","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.643855+0000","last_change":"2024-09-16T07:38:56.589078+0000","last_active":"2024-09-16T07:52:49.643855+0000","last_peered":"2024-09-16T07:52:49.643855+0000","last_clean":"2024-09-16T07:52:49.643855+0000","last_became_active":"2024-09-16T07:38:56.582737+0000","last_became_peered":"2024-09-16T07:38:56.582737+0000","last_unstale":"2024-09-16T07:52:49.643855+0000","last_undegraded":"2024-09-16T07:52:49.643855+0000","last_fullsized":"2024-09-16T07:52:49.643855+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.f","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.632383+0000","last_change":"2024-09-16T07:38:56.647138+0000","last_active":"2024-09-16T07:52:49.632383+0000","last_peered":"2024-09-16T07:52:49.632383+0000","last_clean":"2024-09-16T07:52:49.632383+0000","last_became_active":"2024-09-16T07:38:56.634586+0000","last_became_peered":"2024-09-16T07:38:56.634586+0000","last_unstale":"2024-09-16T07:52:49.632383+0000","last_undegraded":"2024-09-16T07:52:49.632383+0000","last_fullsized":"2024-09-16T07:52:49.632383+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.e","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.604678+0000","last_change":"2024-09-16T07:38:56.563232+0000","last_active":"2024-09-16T07:52:49.604678+0000","last_peered":"2024-09-16T07:52:49.604678+0000","last_clean":"2024-09-16T07:52:49.604678+0000","last_became_active":"2024-09-16T07:38:56.543232+0000","last_became_peered":"2024-09-16T07:38:56.543232+0000","last_unstale":"2024-09-16T07:52:49.604678+0000","last_undegraded":"2024-09-16T07:52:49.604678+0000","last_fullsized":"2024-09-16T07:52:49.604678+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.d","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.610250+0000","last_change":"2024-09-16T07:38:56.548184+0000","last_active":"2024-09-16T07:52:49.610250+0000","last_peered":"2024-09-16T07:52:49.610250+0000","last_clean":"2024-09-16T07:52:49.610250+0000","last_became_active":"2024-09-16T07:38:56.537998+0000","last_became_peered":"2024-09-16T07:38:56.537998+0000","last_unstale":"2024-09-16T07:52:49.610250+0000","last_undegraded":"2024-09-16T07:52:49.610250+0000","last_fullsized":"2024-09-16T07:52:49.610250+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.c","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.626062+0000","last_change":"2024-09-16T07:38:56.600064+0000","last_active":"2024-09-16T07:52:49.626062+0000","last_peered":"2024-09-16T07:52:49.626062+0000","last_clean":"2024-09-16T07:52:49.626062+0000","last_became_active":"2024-09-16T07:38:56.587813+0000","last_became_peered":"2024-09-16T07:38:56.587813+0000","last_unstale":"2024-09-16T07:52:49.626062+0000","last_undegraded":"2024-09-16T07:52:49.626062+0000","last_fullsized":"2024-09-16T07:52:49.626062+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.b","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.617512+0000","last_change":"2024-09-16T07:38:56.605067+0000","last_active":"2024-09-16T07:52:49.617512+0000","last_peered":"2024-09-16T07:52:49.617512+0000","last_clean":"2024-09-16T07:52:49.617512+0000","last_became_active":"2024-09-16T07:38:56.593974+0000","last_became_peered":"2024-09-16T07:38:56.593974+0000","last_unstale":"2024-09-16T07:52:49.617512+0000","last_undegraded":"2024-09-16T07:52:49.617512+0000","last_fullsized":"2024-09-16T07:52:49.617512+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.a","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.595209+0000","last_change":"2024-09-16T07:38:56.536096+0000","last_active":"2024-09-16T07:52:49.595209+0000","last_peered":"2024-09-16T07:52:49.595209+0000","last_clean":"2024-09-16T07:52:49.595209+0000","last_became_active":"2024-09-16T07:38:56.523092+0000","last_became_peered":"2024-09-16T07:38:56.523092+0000","last_unstale":"2024-09-16T07:52:49.595209+0000","last_undegraded":"2024-09-16T07:52:49.595209+0000","last_fullsized":"2024-09-16T07:52:49.595209+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.9","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.611132+0000","last_change":"2024-09-16T07:38:56.552526+0000","last_active":"2024-09-16T07:52:49.611132+0000","last_peered":"2024-09-16T07:52:49.611132+0000","last_clean":"2024-09-16T07:52:49.611132+0000","last_became_active":"2024-09-16T07:38:56.545643+0000","last_became_peered":"2024-09-16T07:38:56.545643+0000","last_unstale":"2024-09-16T07:52:49.611132+0000","last_undegraded":"2024-09-16T07:52:49.611132+0000","last_fullsized":"2024-09-16T07:52:49.611132+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.8","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.609807+0000","last_change":"2024-09-16T07:38:56.657793+0000","last_active":"2024-09-16T07:52:49.609807+0000","last_peered":"2024-09-16T07:52:49.609807+0000","last_clean":"2024-09-16T07:52:49.609807+0000","last_became_active":"2024-09-16T07:38:56.651984+0000","last_became_peered":"2024-09-16T07:38:56.651984+0000","last_unstale":"2024-09-16T07:52:49.609807+0000","last_undegraded":"2024-09-16T07:52:49.609807+0000","last_fullsized":"2024-09-16T07:52:49.609807+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.7","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.601048+0000","last_change":"2024-09-16T07:38:56.624485+0000","last_active":"2024-09-16T07:52:49.601048+0000","last_peered":"2024-09-16T07:52:49.601048+0000","last_clean":"2024-09-16T07:52:49.601048+0000","last_became_active":"2024-09-16T07:38:56.616849+0000","last_became_peered":"2024-09-16T07:38:56.616849+0000","last_unstale":"2024-09-16T07:52:49.601048+0000","last_undegraded":"2024-09-16T07:52:49.601048+0000","last_fullsized":"2024-09-16T07:52:49.601048+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.6","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.644671+0000","last_change":"2024-09-16T07:38:56.531334+0000","last_active":"2024-09-16T07:52:49.644671+0000","last_peered":"2024-09-16T07:52:49.644671+0000","last_clean":"2024-09-16T07:52:49.644671+0000","last_became_active":"2024-09-16T07:38:56.520779+0000","last_became_peered":"2024-09-16T07:38:56.520779+0000","last_unstale":"2024-09-16T07:52:49.644671+0000","last_undegraded":"2024-09-16T07:52:49.644671+0000","last_fullsized":"2024-09-16T07:52:49.644671+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.5","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.600706+0000","last_change":"2024-09-16T07:38:56.590139+0000","last_active":"2024-09-16T07:52:49.600706+0000","last_peered":"2024-09-16T07:52:49.600706+0000","last_clean":"2024-09-16T07:52:49.600706+0000","last_became_active":"2024-09-16T07:38:56.578614+0000","last_became_peered":"2024-09-16T07:38:56.578614+0000","last_unstale":"2024-09-16T07:52:49.600706+0000","last_undegraded":"2024-09-16T07:52:49.600706+0000","last_fullsized":"2024-09-16T07:52:49.600706+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.4","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.628056+0000","last_change":"2024-09-16T07:38:56.684296+0000","last_active":"2024-09-16T07:52:49.628056+0000","last_peered":"2024-09-16T07:52:49.628056+0000","last_clean":"2024-09-16T07:52:49.628056+0000","last_became_active":"2024-09-16T07:38:56.678986+0000","last_became_peered":"2024-09-16T07:38:56.678986+0000","last_unstale":"2024-09-16T07:52:49.628056+0000","last_undegraded":"2024-09-16T07:52:49.628056+0000","last_fullsized":"2024-09-16T07:52:49.628056+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.3","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.623271+0000","last_change":"2024-09-16T07:38:56.574269+0000","last_active":"2024-09-16T07:52:49.623271+0000","last_peered":"2024-09-16T07:52:49.623271+0000","last_clean":"2024-09-16T07:52:49.623271+0000","last_became_active":"2024-09-16T07:38:56.558143+0000","last_became_peered":"2024-09-16T07:38:56.558143+0000","last_unstale":"2024-09-16T07:52:49.623271+0000","last_undegraded":"2024-09-16T07:52:49.623271+0000","last_fullsized":"2024-09-16T07:52:49.623271+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.2","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.611405+0000","last_change":"2024-09-16T07:38:56.563501+0000","last_active":"2024-09-16T07:52:49.611405+0000","last_peered":"2024-09-16T07:52:49.611405+0000","last_clean":"2024-09-16T07:52:49.611405+0000","last_became_active":"2024-09-16T07:38:56.539784+0000","last_became_peered":"2024-09-16T07:38:56.539784+0000","last_unstale":"2024-09-16T07:52:49.611405+0000","last_undegraded":"2024-09-16T07:52:49.611405+0000","last_fullsized":"2024-09-16T07:52:49.611405+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1","version":"239'7","reported_seq":1470,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.607080+0000","last_change":"2024-09-16T07:38:56.532354+0000","last_active":"2024-09-16T07:52:49.607080+0000","last_peered":"2024-09-16T07:52:49.607080+0000","last_clean":"2024-09-16T07:52:49.607080+0000","last_became_active":"2024-09-16T07:38:56.517409+0000","last_became_peered":"2024-09-16T07:38:56.517409+0000","last_unstale":"2024-09-16T07:52:49.607080+0000","last_undegraded":"2024-09-16T07:52:49.607080+0000","last_fullsized":"2024-09-16T07:52:49.607080+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.0","version":"0'0","reported_seq":1457,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.613719+0000","last_change":"2024-09-16T07:38:56.506449+0000","last_active":"2024-09-16T07:52:49.613719+0000","last_peered":"2024-09-16T07:52:49.613719+0000","last_clean":"2024-09-16T07:52:49.613719+0000","last_became_active":"2024-09-16T07:38:56.499378+0000","last_became_peered":"2024-09-16T07:38:56.499378+0000","last_unstale":"2024-09-16T07:52:49.613719+0000","last_undegraded":"2024-09-16T07:52:49.613719+0000","last_fullsized":"2024-09-16T07:52:49.613719+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:38:55.399381+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":2136,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.598810+0000","last_change":"2024-09-16T07:33:55.962652+0000","last_active":"2024-09-16T07:52:49.598810+0000","last_peered":"2024-09-16T07:52:49.598810+0000","last_clean":"2024-09-16T07:52:49.598810+0000","last_became_active":"2024-09-16T07:33:53.988604+0000","last_became_peered":"2024-09-16T07:33:53.988604+0000","last_unstale":"2024-09-16T07:52:49.598810+0000","last_undegraded":"2024-09-16T07:52:49.598810+0000","last_fullsized":"2024-09-16T07:52:49.598810+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_clean_scrub_stamp":"2024-09-16T07:33:52.925999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":2136,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.609334+0000","last_change":"2024-09-16T07:33:55.963562+0000","last_active":"2024-09-16T07:52:49.609334+0000","last_peered":"2024-09-16T07:52:49.609334+0000","last_clean":"2024-09-16T07:52:49.609334+0000","last_became_active":"2024-09-16T07:33:53.999244+0000","last_became_peered":"2024-09-16T07:33:53.999244+0000","last_unstale":"2024-09-16T07:52:49.609334+0000","last_undegraded":"2024-09-16T07:52:49.609334+0000","last_fullsized":"2024-09-16T07:52:49.609334+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_clean_scrub_stamp":"2024-09-16T07:33:52.925999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":2136,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.602588+0000","last_change":"2024-09-16T07:33:55.964565+0000","last_active":"2024-09-16T07:52:49.602588+0000","last_peered":"2024-09-16T07:52:49.602588+0000","last_clean":"2024-09-16T07:52:49.602588+0000","last_became_active":"2024-09-16T07:33:54.001528+0000","last_became_peered":"2024-09-16T07:33:54.001528+0000","last_unstale":"2024-09-16T07:52:49.602588+0000","last_undegraded":"2024-09-16T07:52:49.602588+0000","last_fullsized":"2024-09-16T07:52:49.602588+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_clean_scrub_stamp":"2024-09-16T07:33:52.925999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":2136,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.600990+0000","last_change":"2024-09-16T07:33:55.961854+0000","last_active":"2024-09-16T07:52:49.600990+0000","last_peered":"2024-09-16T07:52:49.600990+0000","last_clean":"2024-09-16T07:52:49.600990+0000","last_became_active":"2024-09-16T07:33:53.989047+0000","last_became_peered":"2024-09-16T07:33:53.989047+0000","last_unstale":"2024-09-16T07:52:49.600990+0000","last_undegraded":"2024-09-16T07:52:49.600990+0000","last_fullsized":"2024-09-16T07:52:49.600990+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_clean_scrub_stamp":"2024-09-16T07:33:52.925999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":2138,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.639851+0000","last_change":"2024-09-16T07:33:55.962135+0000","last_active":"2024-09-16T07:52:49.639851+0000","last_peered":"2024-09-16T07:52:49.639851+0000","last_clean":"2024-09-16T07:52:49.639851+0000","last_became_active":"2024-09-16T07:33:53.989661+0000","last_became_peered":"2024-09-16T07:33:53.989661+0000","last_unstale":"2024-09-16T07:52:49.639851+0000","last_undegraded":"2024-09-16T07:52:49.639851+0000","last_fullsized":"2024-09-16T07:52:49.639851+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_clean_scrub_stamp":"2024-09-16T07:33:52.925999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":2136,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.592683+0000","last_change":"2024-09-16T07:33:55.962959+0000","last_active":"2024-09-16T07:52:49.592683+0000","last_peered":"2024-09-16T07:52:49.592683+0000","last_clean":"2024-09-16T07:52:49.592683+0000","last_became_active":"2024-09-16T07:33:54.001165+0000","last_became_peered":"2024-09-16T07:33:54.001165+0000","last_unstale":"2024-09-16T07:52:49.592683+0000","last_undegraded":"2024-09-16T07:52:49.592683+0000","last_fullsized":"2024-09-16T07:52:49.592683+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_clean_scrub_stamp":"2024-09-16T07:33:52.925999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":2136,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.611341+0000","last_change":"2024-09-16T07:33:55.962311+0000","last_active":"2024-09-16T07:52:49.611341+0000","last_peered":"2024-09-16T07:52:49.611341+0000","last_clean":"2024-09-16T07:52:49.611341+0000","last_became_active":"2024-09-16T07:33:53.998493+0000","last_became_peered":"2024-09-16T07:33:53.998493+0000","last_unstale":"2024-09-16T07:52:49.611341+0000","last_undegraded":"2024-09-16T07:52:49.611341+0000","last_fullsized":"2024-09-16T07:52:49.611341+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_clean_scrub_stamp":"2024-09-16T07:33:52.925999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":2137,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.606316+0000","last_change":"2024-09-16T07:33:55.965013+0000","last_active":"2024-09-16T07:52:49.606316+0000","last_peered":"2024-09-16T07:52:49.606316+0000","last_clean":"2024-09-16T07:52:49.606316+0000","last_became_active":"2024-09-16T07:33:54.007370+0000","last_became_peered":"2024-09-16T07:33:54.007370+0000","last_unstale":"2024-09-16T07:52:49.606316+0000","last_undegraded":"2024-09-16T07:52:49.606316+0000","last_fullsized":"2024-09-16T07:52:49.606316+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:52.925999+0000","last_clean_scrub_stamp":"2024-09-16T07:33:52.925999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":2208,"reported_epoch":722,"state":"active+clean","last_fresh":"2024-09-16T07:52:49.598687+0000","last_change":"2024-09-16T07:33:51.972549+0000","last_active":"2024-09-16T07:52:49.598687+0000","last_peered":"2024-09-16T07:52:49.598687+0000","last_clean":"2024-09-16T07:52:49.598687+0000","last_became_active":"2024-09-16T07:33:51.963446+0000","last_became_peered":"2024-09-16T07:33:51.963446+0000","last_unstale":"2024-09-16T07:52:49.598687+0000","last_undegraded":"2024-09-16T07:52:49.598687+0000","last_fullsized":"2024-09-16T07:52:49.598687+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:50.923539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:50.923539+0000","last_clean_scrub_stamp":"2024-09-16T07:33:50.923539+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":75,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30044,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":63300,"kb_used_data":1780,"kb_used_omap":0,"kb_used_meta":61504,"kb_avail":94308540,"statfs":{"total":96636764160,"available":96571944960,"internally_reserved":0,"allocated":1822720,"data_stored":1158276,"data_compressed":59484,"data_compressed_allocated":81920,"data_compressed_original":634880,"omap_allocated":0,"internal_metadata":62980096},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":64668,"kb_used_data":1740,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94307172,"statfs":{"total":96636764160,"available":96570544128,"internally_reserved":0,"allocated":1781760,"data_stored":580807,"data_compressed":35328,"data_compressed_allocated":49152,"data_compressed_original":73728,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59084,"kb_used_data":1724,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94312756,"statfs":{"total":96636764160,"available":96576262144,"internally_reserved":0,"allocated":1765376,"data_stored":567913,"data_compressed":29440,"data_compressed_allocated":40960,"data_compressed_original":61440,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":68884,"kb_used_data":1796,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94302956,"statfs":{"total":96636764160,"available":96566226944,"internally_reserved":0,"allocated":1839104,"data_stored":1171170,"data_compressed":65372,"data_compressed_allocated":90112,"data_compressed_original":647168,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30044,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:53:16.034 INFO:tasks.ceph:pgid 75.1f last_scrub_stamp 2024-09-16T07:38:55.399381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=38, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:53:16.034 INFO:tasks.ceph:pgid 75.1e last_scrub_stamp 2024-09-16T07:38:55.399381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=38, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:53:16.034 INFO:tasks.ceph:pgid 75.1d last_scrub_stamp 2024-09-16T07:38:55.399381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=38, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:53:16.034 INFO:tasks.ceph:pgid 75.1c last_scrub_stamp 2024-09-16T07:38:55.399381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=38, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:53:16.035 INFO:tasks.ceph:pgid 75.1b last_scrub_stamp 2024-09-16T07:38:55.399381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=38, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:53:16.035 INFO:tasks.ceph:pgid 75.1a last_scrub_stamp 2024-09-16T07:38:55.399381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=38, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:53:16.035 INFO:tasks.ceph:pgid 75.19 last_scrub_stamp 2024-09-16T07:38:55.399381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=38, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:53:16.035 INFO:tasks.ceph:pgid 75.18 last_scrub_stamp 2024-09-16T07:38:55.399381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=38, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:53:16.035 INFO:tasks.ceph:pgid 75.17 last_scrub_stamp 2024-09-16T07:38:55.399381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=38, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:53:16.035 INFO:tasks.ceph:pgid 75.16 last_scrub_stamp 2024-09-16T07:38:55.399381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=38, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:53:16.035 INFO:tasks.ceph:pgid 75.15 last_scrub_stamp 2024-09-16T07:38:55.399381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=38, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:53:16.035 INFO:tasks.ceph:pgid 75.14 last_scrub_stamp 2024-09-16T07:38:55.399381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=38, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:53:16.036 INFO:tasks.ceph:pgid 75.13 last_scrub_stamp 2024-09-16T07:38:55.399381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=38, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:53:16.036 INFO:tasks.ceph:pgid 75.12 last_scrub_stamp 2024-09-16T07:38:55.399381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=38, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:53:16.036 INFO:tasks.ceph:pgid 75.11 last_scrub_stamp 2024-09-16T07:38:55.399381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=38, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:53:16.036 INFO:tasks.ceph:pgid 75.10 last_scrub_stamp 2024-09-16T07:38:55.399381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=38, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:53:16.036 INFO:tasks.ceph:pgid 75.f last_scrub_stamp 2024-09-16T07:38:55.399381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=38, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:53:16.036 INFO:tasks.ceph:pgid 75.e last_scrub_stamp 2024-09-16T07:38:55.399381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=38, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:53:16.037 INFO:tasks.ceph:pgid 75.d last_scrub_stamp 2024-09-16T07:38:55.399381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=38, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:53:16.037 INFO:tasks.ceph:pgid 75.c last_scrub_stamp 2024-09-16T07:38:55.399381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=38, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:53:16.037 INFO:tasks.ceph:pgid 75.b last_scrub_stamp 2024-09-16T07:38:55.399381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=38, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:53:16.037 INFO:tasks.ceph:pgid 75.a last_scrub_stamp 2024-09-16T07:38:55.399381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=38, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:53:16.037 INFO:tasks.ceph:pgid 75.9 last_scrub_stamp 2024-09-16T07:38:55.399381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=38, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:53:16.037 INFO:tasks.ceph:pgid 75.8 last_scrub_stamp 2024-09-16T07:38:55.399381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=38, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:53:16.038 INFO:tasks.ceph:pgid 75.7 last_scrub_stamp 2024-09-16T07:38:55.399381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=38, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:53:16.038 INFO:tasks.ceph:pgid 75.6 last_scrub_stamp 2024-09-16T07:38:55.399381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=38, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:53:16.038 INFO:tasks.ceph:pgid 75.5 last_scrub_stamp 2024-09-16T07:38:55.399381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=38, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:53:16.038 INFO:tasks.ceph:pgid 75.4 last_scrub_stamp 2024-09-16T07:38:55.399381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=38, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:53:16.038 INFO:tasks.ceph:pgid 75.3 last_scrub_stamp 2024-09-16T07:38:55.399381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=38, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:53:16.038 INFO:tasks.ceph:pgid 75.2 last_scrub_stamp 2024-09-16T07:38:55.399381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=38, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:53:16.038 INFO:tasks.ceph:pgid 75.1 last_scrub_stamp 2024-09-16T07:38:55.399381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=38, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:53:16.038 INFO:tasks.ceph:pgid 75.0 last_scrub_stamp 2024-09-16T07:38:55.399381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=38, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:53:16.038 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-16T07:33:52.925999+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=33, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:53:16.039 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-16T07:33:52.925999+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=33, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:53:16.039 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-16T07:33:52.925999+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=33, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:53:16.039 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-16T07:33:52.925999+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=33, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:53:16.039 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-16T07:33:52.925999+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=33, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:53:16.039 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-16T07:33:52.925999+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=33, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:53:16.039 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-16T07:33:52.925999+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=33, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:53:16.039 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-16T07:33:52.925999+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=33, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:53:16.039 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-16T07:33:50.923539+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=33, tm_sec=50, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=52, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:53:16.039 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T07:53:36.041 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:53:36.159 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.156+0000 7ffb3526c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:36.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.161+0000 7ffb3526c640 1 Processor -- start 2024-09-16T07:53:36.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.161+0000 7ffb3526c640 1 -- start start 2024-09-16T07:53:36.162 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.162+0000 7ffb3526c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ffb3006fec0 0x7ffb30138020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:53:36.162 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.163+0000 7ffb3526c640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb3006ed60 con 0x7ffb3006f3a0 2024-09-16T07:53:36.162 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.163+0000 7ffb3526c640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7ffb300a3ed0 con 0x7ffb3006fec0 2024-09-16T07:53:36.162 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.163+0000 7ffb267fc640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ffb3006fec0 0x7ffb30138020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:53:36.162 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.163+0000 7ffb2effd640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7ffb3006f3a0 0x7ffb3006f7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:52248/0 (socket says 172.21.15.121:52248) 2024-09-16T07:53:36.162 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.163+0000 7ffb2effd640 1 -- 172.21.15.121:0/1658162409 learned_addr learned my addr 172.21.15.121:0/1658162409 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-16T07:53:36.162 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.163+0000 7ffb267fc640 1 -- 172.21.15.121:0/1658162409 >> v1:172.21.15.121:6789/0 conn(0x7ffb3006f3a0 legacy=0x7ffb3006f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:53:36.163 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.163+0000 7ffb267fc640 1 -- 172.21.15.121:0/1658162409 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb300a4170 con 0x7ffb3006fec0 2024-09-16T07:53:36.163 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.163+0000 7ffb267fc640 1 --2- 172.21.15.121:0/1658162409 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffb3006fec0 0x7ffb30138020 crc :-1 s=READY pgs=13035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab722cba7be71a76 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:53:36.163 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.163+0000 7ffb2e7fc640 1 -- 172.21.15.121:0/1658162409 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ffb18009d80 con 0x7ffb3006fec0 2024-09-16T07:53:36.163 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.163+0000 7ffb2e7fc640 1 -- 172.21.15.121:0/1658162409 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ffb1800e230 con 0x7ffb3006fec0 2024-09-16T07:53:36.163 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.163+0000 7ffb2e7fc640 1 -- 172.21.15.121:0/1658162409 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ffb1800e4d0 con 0x7ffb3006fec0 2024-09-16T07:53:36.164 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.164+0000 7ffb3526c640 1 -- 172.21.15.121:0/1658162409 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffb3006fec0 msgr2=0x7ffb30138020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:53:36.164 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.164+0000 7ffb3526c640 1 --2- 172.21.15.121:0/1658162409 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffb3006fec0 0x7ffb30138020 crc :-1 s=READY pgs=13035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:53:36.164 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.164+0000 7ffb3526c640 1 -- 172.21.15.121:0/1658162409 shutdown_connections 2024-09-16T07:53:36.164 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.164+0000 7ffb3526c640 1 --2- 172.21.15.121:0/1658162409 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffb3006fec0 0x7ffb30138020 unknown :-1 s=CLOSED pgs=13035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:53:36.164 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.164+0000 7ffb3526c640 1 -- 172.21.15.121:0/1658162409 >> 172.21.15.121:0/1658162409 conn(0x7ffb300a33b0 msgr2=0x7ffb300a37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:53:36.164 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.164+0000 7ffb3526c640 1 -- 172.21.15.121:0/1658162409 shutdown_connections 2024-09-16T07:53:36.164 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.164+0000 7ffb3526c640 1 -- 172.21.15.121:0/1658162409 wait complete. 2024-09-16T07:53:36.164 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.164+0000 7ffb3526c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:36.165 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.166+0000 7ffb3526c640 1 Processor -- start 2024-09-16T07:53:36.165 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.166+0000 7ffb3526c640 1 -- start start 2024-09-16T07:53:36.166 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.167+0000 7ffb3526c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffb3006f3a0 0x7ffb301c8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:53:36.166 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.167+0000 7ffb3526c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ffb300703b0 con 0x7ffb3006f3a0 2024-09-16T07:53:36.166 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.167+0000 7ffb2effd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffb3006f3a0 0x7ffb301c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:53:36.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.167+0000 7ffb2effd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffb3006f3a0 0x7ffb301c8790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:49238/0 (socket says 172.21.15.121:49238) 2024-09-16T07:53:36.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.167+0000 7ffb2effd640 1 -- 172.21.15.121:0/1177963811 learned_addr learned my addr 172.21.15.121:0/1177963811 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:53:36.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.167+0000 7ffb2effd640 1 -- 172.21.15.121:0/1177963811 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb30121d50 con 0x7ffb3006f3a0 2024-09-16T07:53:36.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.167+0000 7ffb2effd640 1 --2- 172.21.15.121:0/1177963811 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffb3006f3a0 0x7ffb301c8790 crc :-1 s=READY pgs=13036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:53:36.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.167+0000 7ffb27fff640 1 -- 172.21.15.121:0/1177963811 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ffb20005a60 con 0x7ffb3006f3a0 2024-09-16T07:53:36.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.167+0000 7ffb27fff640 1 -- 172.21.15.121:0/1177963811 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ffb20005bc0 con 0x7ffb3006f3a0 2024-09-16T07:53:36.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.167+0000 7ffb3526c640 1 -- 172.21.15.121:0/1177963811 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb30073860 con 0x7ffb3006f3a0 2024-09-16T07:53:36.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.167+0000 7ffb27fff640 1 -- 172.21.15.121:0/1177963811 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ffb20005e60 con 0x7ffb3006f3a0 2024-09-16T07:53:36.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.167+0000 7ffb3526c640 1 -- 172.21.15.121:0/1177963811 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb301219b0 con 0x7ffb3006f3a0 2024-09-16T07:53:36.168 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.168+0000 7ffb3526c640 1 -- 172.21.15.121:0/1177963811 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb30123350 con 0x7ffb3006f3a0 2024-09-16T07:53:36.168 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.169+0000 7ffb27fff640 1 -- 172.21.15.121:0/1177963811 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7ffb200070b0 con 0x7ffb3006f3a0 2024-09-16T07:53:36.168 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.169+0000 7ffb27fff640 1 --2- 172.21.15.121:0/1177963811 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7ffb1003e930 0x7ffb10040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:53:36.168 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.169+0000 7ffb27fff640 1 -- 172.21.15.121:0/1177963811 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(723..723 src has 620..723) ==== 3431+0+0 (crc 0 0 0) 0x7ffb2004f9a0 con 0x7ffb3006f3a0 2024-09-16T07:53:36.168 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.169+0000 7ffb267fc640 1 --2- 172.21.15.121:0/1177963811 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7ffb1003e930 0x7ffb10040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:53:36.168 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.170+0000 7ffb267fc640 1 --2- 172.21.15.121:0/1177963811 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7ffb1003e930 0x7ffb10040e40 crc :-1 s=READY pgs=3858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:53:36.173 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.174+0000 7ffb27fff640 1 -- 172.21.15.121:0/1177963811 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7ffb2000dc10 con 0x7ffb3006f3a0 2024-09-16T07:53:36.345 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.346+0000 7ffb3526c640 1 -- 172.21.15.121:0/1177963811 --> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ffb301259e0 con 0x7ffb1003e930 2024-09-16T07:53:36.348 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.349+0000 7ffb27fff640 1 -- 172.21.15.121:0/1177963811 <== mgr.4102 v2:172.21.15.172:6800/643901738 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+109193 (crc 0 0 0) 0x7ffb301259e0 con 0x7ffb1003e930 2024-09-16T07:53:36.349 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-16T07:53:36.349 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-09-16T07:53:36.351 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.351+0000 7ffb3526c640 1 -- 172.21.15.121:0/1177963811 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7ffb1003e930 msgr2=0x7ffb10040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:53:36.351 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.351+0000 7ffb3526c640 1 --2- 172.21.15.121:0/1177963811 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7ffb1003e930 0x7ffb10040e40 crc :-1 s=READY pgs=3858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:53:36.351 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.351+0000 7ffb3526c640 1 -- 172.21.15.121:0/1177963811 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffb3006f3a0 msgr2=0x7ffb301c8790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:53:36.351 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.351+0000 7ffb3526c640 1 --2- 172.21.15.121:0/1177963811 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffb3006f3a0 0x7ffb301c8790 crc :-1 s=READY pgs=13036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:53:36.351 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.352+0000 7ffb3526c640 1 -- 172.21.15.121:0/1177963811 shutdown_connections 2024-09-16T07:53:36.351 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.352+0000 7ffb3526c640 1 --2- 172.21.15.121:0/1177963811 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7ffb1003e930 0x7ffb10040e40 unknown :-1 s=CLOSED pgs=3858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:53:36.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.352+0000 7ffb3526c640 1 --2- 172.21.15.121:0/1177963811 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffb3006f3a0 0x7ffb301c8790 unknown :-1 s=CLOSED pgs=13036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:53:36.353 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.352+0000 7ffb3526c640 1 -- 172.21.15.121:0/1177963811 >> 172.21.15.121:0/1177963811 conn(0x7ffb300a33b0 msgr2=0x7ffb3011ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:53:36.353 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.352+0000 7ffb3526c640 1 -- 172.21.15.121:0/1177963811 shutdown_connections 2024-09-16T07:53:36.353 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.352+0000 7ffb3526c640 1 -- 172.21.15.121:0/1177963811 wait complete. 2024-09-16T07:53:36.362 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":1308,"stamp":"2024-09-16T07:53:35.140193+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590392,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":52,"num_write":88,"num_write_kb":1115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":62,"ondisk_log_size":62,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":255720,"kb_used_data":6824,"kb_used_omap":0,"kb_used_meta":248832,"kb_avail":377231640,"statfs":{"total":386547056640,"available":386285199360,"internally_reserved":0,"allocated":6987776,"data_stored":3210976,"data_compressed":60088,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":254803968},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002861"},"pg_stats":[{"pgid":"75.1f","version":"0'0","reported_seq":1462,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-16T07:52:54.456468+0000","last_change":"2024-09-16T07:52:54.471766+0000","last_active":"2024-09-16T07:52:54.456468+0000","last_peered":"2024-09-16T07:52:54.456468+0000","last_clean":"2024-09-16T07:52:54.456468+0000","last_became_active":"2024-09-16T07:38:56.541997+0000","last_became_peered":"2024-09-16T07:38:56.541997+0000","last_unstale":"2024-09-16T07:52:54.456468+0000","last_undegraded":"2024-09-16T07:52:54.456468+0000","last_fullsized":"2024-09-16T07:52:54.456468+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:54.471475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:54.471475+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1e","version":"0'0","reported_seq":1462,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-16T07:52:53.986979+0000","last_change":"2024-09-16T07:52:54.004734+0000","last_active":"2024-09-16T07:52:53.986979+0000","last_peered":"2024-09-16T07:52:53.986979+0000","last_clean":"2024-09-16T07:52:53.986979+0000","last_became_active":"2024-09-16T07:38:56.548814+0000","last_became_peered":"2024-09-16T07:38:56.548814+0000","last_unstale":"2024-09-16T07:52:53.986979+0000","last_undegraded":"2024-09-16T07:52:53.986979+0000","last_fullsized":"2024-09-16T07:52:53.986979+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:54.004569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:54.004569+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1d","version":"0'0","reported_seq":1462,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-16T07:52:54.920249+0000","last_change":"2024-09-16T07:52:54.937886+0000","last_active":"2024-09-16T07:52:54.920249+0000","last_peered":"2024-09-16T07:52:54.920249+0000","last_clean":"2024-09-16T07:52:54.920249+0000","last_became_active":"2024-09-16T07:38:56.543879+0000","last_became_peered":"2024-09-16T07:38:56.543879+0000","last_unstale":"2024-09-16T07:52:54.920249+0000","last_undegraded":"2024-09-16T07:52:54.920249+0000","last_fullsized":"2024-09-16T07:52:54.920249+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:54.937692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:54.937692+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.1c","version":"0'0","reported_seq":1462,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-16T07:52:55.385948+0000","last_change":"2024-09-16T07:52:55.416241+0000","last_active":"2024-09-16T07:52:55.385948+0000","last_peered":"2024-09-16T07:52:55.385948+0000","last_clean":"2024-09-16T07:52:55.385948+0000","last_became_active":"2024-09-16T07:38:56.593078+0000","last_became_peered":"2024-09-16T07:38:56.593078+0000","last_unstale":"2024-09-16T07:52:55.385948+0000","last_undegraded":"2024-09-16T07:52:55.385948+0000","last_fullsized":"2024-09-16T07:52:55.385948+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:55.416050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:55.416050+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1b","version":"0'0","reported_seq":1462,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-16T07:52:54.455994+0000","last_change":"2024-09-16T07:52:54.477096+0000","last_active":"2024-09-16T07:52:54.455994+0000","last_peered":"2024-09-16T07:52:54.455994+0000","last_clean":"2024-09-16T07:52:54.455994+0000","last_became_active":"2024-09-16T07:38:56.546684+0000","last_became_peered":"2024-09-16T07:38:56.546684+0000","last_unstale":"2024-09-16T07:52:54.455994+0000","last_undegraded":"2024-09-16T07:52:54.455994+0000","last_fullsized":"2024-09-16T07:52:54.455994+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:54.476934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:54.476934+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1a","version":"0'0","reported_seq":1462,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-16T07:52:53.979682+0000","last_change":"2024-09-16T07:52:54.001539+0000","last_active":"2024-09-16T07:52:53.979682+0000","last_peered":"2024-09-16T07:52:53.979682+0000","last_clean":"2024-09-16T07:52:53.979682+0000","last_became_active":"2024-09-16T07:38:56.532518+0000","last_became_peered":"2024-09-16T07:38:56.532518+0000","last_unstale":"2024-09-16T07:52:53.979682+0000","last_undegraded":"2024-09-16T07:52:53.979682+0000","last_fullsized":"2024-09-16T07:52:53.979682+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:54.001374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:54.001374+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.19","version":"0'0","reported_seq":1462,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-16T07:52:53.981741+0000","last_change":"2024-09-16T07:52:54.000543+0000","last_active":"2024-09-16T07:52:53.981741+0000","last_peered":"2024-09-16T07:52:53.981741+0000","last_clean":"2024-09-16T07:52:53.981741+0000","last_became_active":"2024-09-16T07:38:56.606292+0000","last_became_peered":"2024-09-16T07:38:56.606292+0000","last_unstale":"2024-09-16T07:52:53.981741+0000","last_undegraded":"2024-09-16T07:52:53.981741+0000","last_fullsized":"2024-09-16T07:52:53.981741+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:54.000262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:54.000262+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.18","version":"0'0","reported_seq":1462,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-16T07:52:53.983062+0000","last_change":"2024-09-16T07:52:54.002796+0000","last_active":"2024-09-16T07:52:53.983062+0000","last_peered":"2024-09-16T07:52:53.983062+0000","last_clean":"2024-09-16T07:52:53.983062+0000","last_became_active":"2024-09-16T07:38:56.630903+0000","last_became_peered":"2024-09-16T07:38:56.630903+0000","last_unstale":"2024-09-16T07:52:53.983062+0000","last_undegraded":"2024-09-16T07:52:53.983062+0000","last_fullsized":"2024-09-16T07:52:53.983062+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:54.002563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:54.002563+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.17","version":"0'0","reported_seq":1462,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-16T07:52:55.386959+0000","last_change":"2024-09-16T07:52:55.416679+0000","last_active":"2024-09-16T07:52:55.386959+0000","last_peered":"2024-09-16T07:52:55.386959+0000","last_clean":"2024-09-16T07:52:55.386959+0000","last_became_active":"2024-09-16T07:38:56.515359+0000","last_became_peered":"2024-09-16T07:38:56.515359+0000","last_unstale":"2024-09-16T07:52:55.386959+0000","last_undegraded":"2024-09-16T07:52:55.386959+0000","last_fullsized":"2024-09-16T07:52:55.386959+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:55.416502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:55.416502+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.16","version":"0'0","reported_seq":1462,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-16T07:52:54.917763+0000","last_change":"2024-09-16T07:52:54.931762+0000","last_active":"2024-09-16T07:52:54.917763+0000","last_peered":"2024-09-16T07:52:54.917763+0000","last_clean":"2024-09-16T07:52:54.917763+0000","last_became_active":"2024-09-16T07:38:56.511359+0000","last_became_peered":"2024-09-16T07:38:56.511359+0000","last_unstale":"2024-09-16T07:52:54.917763+0000","last_undegraded":"2024-09-16T07:52:54.917763+0000","last_fullsized":"2024-09-16T07:52:54.917763+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:54.931444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:54.931444+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.15","version":"0'0","reported_seq":1462,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-16T07:52:55.383340+0000","last_change":"2024-09-16T07:52:55.414149+0000","last_active":"2024-09-16T07:52:55.383340+0000","last_peered":"2024-09-16T07:52:55.383340+0000","last_clean":"2024-09-16T07:52:55.383340+0000","last_became_active":"2024-09-16T07:38:56.572269+0000","last_became_peered":"2024-09-16T07:38:56.572269+0000","last_unstale":"2024-09-16T07:52:55.383340+0000","last_undegraded":"2024-09-16T07:52:55.383340+0000","last_fullsized":"2024-09-16T07:52:55.383340+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:55.413951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:55.413951+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.14","version":"0'0","reported_seq":1462,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-16T07:52:53.976975+0000","last_change":"2024-09-16T07:52:53.991425+0000","last_active":"2024-09-16T07:52:53.976975+0000","last_peered":"2024-09-16T07:52:53.976975+0000","last_clean":"2024-09-16T07:52:53.976975+0000","last_became_active":"2024-09-16T07:38:56.597598+0000","last_became_peered":"2024-09-16T07:38:56.597598+0000","last_unstale":"2024-09-16T07:52:53.976975+0000","last_undegraded":"2024-09-16T07:52:53.976975+0000","last_fullsized":"2024-09-16T07:52:53.976975+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:53.991262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:53.991262+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.13","version":"0'0","reported_seq":1462,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-16T07:52:55.381349+0000","last_change":"2024-09-16T07:52:55.407987+0000","last_active":"2024-09-16T07:52:55.381349+0000","last_peered":"2024-09-16T07:52:55.381349+0000","last_clean":"2024-09-16T07:52:55.381349+0000","last_became_active":"2024-09-16T07:38:56.612776+0000","last_became_peered":"2024-09-16T07:38:56.612776+0000","last_unstale":"2024-09-16T07:52:55.381349+0000","last_undegraded":"2024-09-16T07:52:55.381349+0000","last_fullsized":"2024-09-16T07:52:55.381349+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:55.407801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:55.407801+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.12","version":"0'0","reported_seq":1462,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-16T07:52:55.378584+0000","last_change":"2024-09-16T07:52:55.404957+0000","last_active":"2024-09-16T07:52:55.378584+0000","last_peered":"2024-09-16T07:52:55.378584+0000","last_clean":"2024-09-16T07:52:55.378584+0000","last_became_active":"2024-09-16T07:38:56.549760+0000","last_became_peered":"2024-09-16T07:38:56.549760+0000","last_unstale":"2024-09-16T07:52:55.378584+0000","last_undegraded":"2024-09-16T07:52:55.378584+0000","last_fullsized":"2024-09-16T07:52:55.378584+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:55.404740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:55.404740+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.11","version":"0'0","reported_seq":1462,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-16T07:52:53.979188+0000","last_change":"2024-09-16T07:52:53.998250+0000","last_active":"2024-09-16T07:52:53.979188+0000","last_peered":"2024-09-16T07:52:53.979188+0000","last_clean":"2024-09-16T07:52:53.979188+0000","last_became_active":"2024-09-16T07:38:56.627154+0000","last_became_peered":"2024-09-16T07:38:56.627154+0000","last_unstale":"2024-09-16T07:52:53.979188+0000","last_undegraded":"2024-09-16T07:52:53.979188+0000","last_fullsized":"2024-09-16T07:52:53.979188+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:53.998090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:53.998090+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.10","version":"0'0","reported_seq":1462,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-16T07:52:53.980064+0000","last_change":"2024-09-16T07:52:53.996342+0000","last_active":"2024-09-16T07:52:53.980064+0000","last_peered":"2024-09-16T07:52:53.980064+0000","last_clean":"2024-09-16T07:52:53.980064+0000","last_became_active":"2024-09-16T07:38:56.582737+0000","last_became_peered":"2024-09-16T07:38:56.582737+0000","last_unstale":"2024-09-16T07:52:53.980064+0000","last_undegraded":"2024-09-16T07:52:53.980064+0000","last_fullsized":"2024-09-16T07:52:53.980064+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:53.996068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:53.996068+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.f","version":"0'0","reported_seq":1462,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-16T07:52:53.978068+0000","last_change":"2024-09-16T07:52:54.003495+0000","last_active":"2024-09-16T07:52:53.978068+0000","last_peered":"2024-09-16T07:52:53.978068+0000","last_clean":"2024-09-16T07:52:53.978068+0000","last_became_active":"2024-09-16T07:38:56.634586+0000","last_became_peered":"2024-09-16T07:38:56.634586+0000","last_unstale":"2024-09-16T07:52:53.978068+0000","last_undegraded":"2024-09-16T07:52:53.978068+0000","last_fullsized":"2024-09-16T07:52:53.978068+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:54.003333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:54.003333+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.e","version":"0'0","reported_seq":1462,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-16T07:52:55.376411+0000","last_change":"2024-09-16T07:52:55.411081+0000","last_active":"2024-09-16T07:52:55.376411+0000","last_peered":"2024-09-16T07:52:55.376411+0000","last_clean":"2024-09-16T07:52:55.376411+0000","last_became_active":"2024-09-16T07:38:56.543232+0000","last_became_peered":"2024-09-16T07:38:56.543232+0000","last_unstale":"2024-09-16T07:52:55.376411+0000","last_undegraded":"2024-09-16T07:52:55.376411+0000","last_fullsized":"2024-09-16T07:52:55.376411+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:55.410873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:55.410873+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.d","version":"0'0","reported_seq":1462,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-16T07:52:54.918906+0000","last_change":"2024-09-16T07:52:54.935870+0000","last_active":"2024-09-16T07:52:54.918906+0000","last_peered":"2024-09-16T07:52:54.918906+0000","last_clean":"2024-09-16T07:52:54.918906+0000","last_became_active":"2024-09-16T07:38:56.537998+0000","last_became_peered":"2024-09-16T07:38:56.537998+0000","last_unstale":"2024-09-16T07:52:54.918906+0000","last_undegraded":"2024-09-16T07:52:54.918906+0000","last_fullsized":"2024-09-16T07:52:54.918906+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:54.935662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:54.935662+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.c","version":"0'0","reported_seq":1462,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-16T07:52:54.453414+0000","last_change":"2024-09-16T07:52:54.476931+0000","last_active":"2024-09-16T07:52:54.453414+0000","last_peered":"2024-09-16T07:52:54.453414+0000","last_clean":"2024-09-16T07:52:54.453414+0000","last_became_active":"2024-09-16T07:38:56.587813+0000","last_became_peered":"2024-09-16T07:38:56.587813+0000","last_unstale":"2024-09-16T07:52:54.453414+0000","last_undegraded":"2024-09-16T07:52:54.453414+0000","last_fullsized":"2024-09-16T07:52:54.453414+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:54.476621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:54.476621+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.b","version":"0'0","reported_seq":1462,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-16T07:52:54.451874+0000","last_change":"2024-09-16T07:52:54.475264+0000","last_active":"2024-09-16T07:52:54.451874+0000","last_peered":"2024-09-16T07:52:54.451874+0000","last_clean":"2024-09-16T07:52:54.451874+0000","last_became_active":"2024-09-16T07:38:56.593974+0000","last_became_peered":"2024-09-16T07:38:56.593974+0000","last_unstale":"2024-09-16T07:52:54.451874+0000","last_undegraded":"2024-09-16T07:52:54.451874+0000","last_fullsized":"2024-09-16T07:52:54.451874+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:54.474962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:54.474962+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.a","version":"0'0","reported_seq":1462,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-16T07:52:54.449440+0000","last_change":"2024-09-16T07:52:54.469016+0000","last_active":"2024-09-16T07:52:54.449440+0000","last_peered":"2024-09-16T07:52:54.449440+0000","last_clean":"2024-09-16T07:52:54.449440+0000","last_became_active":"2024-09-16T07:38:56.523092+0000","last_became_peered":"2024-09-16T07:38:56.523092+0000","last_unstale":"2024-09-16T07:52:54.449440+0000","last_undegraded":"2024-09-16T07:52:54.449440+0000","last_fullsized":"2024-09-16T07:52:54.449440+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:54.468830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:54.468830+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.9","version":"0'0","reported_seq":1462,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-16T07:52:54.917904+0000","last_change":"2024-09-16T07:52:54.934871+0000","last_active":"2024-09-16T07:52:54.917904+0000","last_peered":"2024-09-16T07:52:54.917904+0000","last_clean":"2024-09-16T07:52:54.917904+0000","last_became_active":"2024-09-16T07:38:56.545643+0000","last_became_peered":"2024-09-16T07:38:56.545643+0000","last_unstale":"2024-09-16T07:52:54.917904+0000","last_undegraded":"2024-09-16T07:52:54.917904+0000","last_fullsized":"2024-09-16T07:52:54.917904+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:54.934649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:54.934649+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.8","version":"0'0","reported_seq":1462,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-16T07:52:55.378559+0000","last_change":"2024-09-16T07:52:55.403878+0000","last_active":"2024-09-16T07:52:55.378559+0000","last_peered":"2024-09-16T07:52:55.378559+0000","last_clean":"2024-09-16T07:52:55.378559+0000","last_became_active":"2024-09-16T07:38:56.651984+0000","last_became_peered":"2024-09-16T07:38:56.651984+0000","last_unstale":"2024-09-16T07:52:55.378559+0000","last_undegraded":"2024-09-16T07:52:55.378559+0000","last_fullsized":"2024-09-16T07:52:55.378559+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:55.403646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:55.403646+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.7","version":"0'0","reported_seq":1462,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-16T07:52:55.375759+0000","last_change":"2024-09-16T07:52:55.409103+0000","last_active":"2024-09-16T07:52:55.375759+0000","last_peered":"2024-09-16T07:52:55.375759+0000","last_clean":"2024-09-16T07:52:55.375759+0000","last_became_active":"2024-09-16T07:38:56.616849+0000","last_became_peered":"2024-09-16T07:38:56.616849+0000","last_unstale":"2024-09-16T07:52:55.375759+0000","last_undegraded":"2024-09-16T07:52:55.375759+0000","last_fullsized":"2024-09-16T07:52:55.375759+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:55.408906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:55.408906+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.6","version":"0'0","reported_seq":1462,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-16T07:52:53.976711+0000","last_change":"2024-09-16T07:52:53.995179+0000","last_active":"2024-09-16T07:52:53.976711+0000","last_peered":"2024-09-16T07:52:53.976711+0000","last_clean":"2024-09-16T07:52:53.976711+0000","last_became_active":"2024-09-16T07:38:56.520779+0000","last_became_peered":"2024-09-16T07:38:56.520779+0000","last_unstale":"2024-09-16T07:52:53.976711+0000","last_undegraded":"2024-09-16T07:52:53.976711+0000","last_fullsized":"2024-09-16T07:52:53.976711+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:53.995002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:53.995002+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.5","version":"0'0","reported_seq":1462,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-16T07:52:55.375712+0000","last_change":"2024-09-16T07:52:55.394512+0000","last_active":"2024-09-16T07:52:55.375712+0000","last_peered":"2024-09-16T07:52:55.375712+0000","last_clean":"2024-09-16T07:52:55.375712+0000","last_became_active":"2024-09-16T07:38:56.578614+0000","last_became_peered":"2024-09-16T07:38:56.578614+0000","last_unstale":"2024-09-16T07:52:55.375712+0000","last_undegraded":"2024-09-16T07:52:55.375712+0000","last_fullsized":"2024-09-16T07:52:55.375712+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:55.394160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:55.394160+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.4","version":"0'0","reported_seq":1462,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-16T07:52:53.978084+0000","last_change":"2024-09-16T07:52:54.000253+0000","last_active":"2024-09-16T07:52:53.978084+0000","last_peered":"2024-09-16T07:52:53.978084+0000","last_clean":"2024-09-16T07:52:53.978084+0000","last_became_active":"2024-09-16T07:38:56.678986+0000","last_became_peered":"2024-09-16T07:38:56.678986+0000","last_unstale":"2024-09-16T07:52:53.978084+0000","last_undegraded":"2024-09-16T07:52:53.978084+0000","last_fullsized":"2024-09-16T07:52:53.978084+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:53.999969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:53.999969+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.3","version":"0'0","reported_seq":1462,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-16T07:52:53.976436+0000","last_change":"2024-09-16T07:52:53.997101+0000","last_active":"2024-09-16T07:52:53.976436+0000","last_peered":"2024-09-16T07:52:53.976436+0000","last_clean":"2024-09-16T07:52:53.976436+0000","last_became_active":"2024-09-16T07:38:56.558143+0000","last_became_peered":"2024-09-16T07:38:56.558143+0000","last_unstale":"2024-09-16T07:52:53.976436+0000","last_undegraded":"2024-09-16T07:52:53.976436+0000","last_fullsized":"2024-09-16T07:52:53.976436+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:53.996892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:53.996892+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.2","version":"0'0","reported_seq":1462,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-16T07:52:53.974337+0000","last_change":"2024-09-16T07:52:53.988207+0000","last_active":"2024-09-16T07:52:53.974337+0000","last_peered":"2024-09-16T07:52:53.974337+0000","last_clean":"2024-09-16T07:52:53.974337+0000","last_became_active":"2024-09-16T07:38:56.539784+0000","last_became_peered":"2024-09-16T07:38:56.539784+0000","last_unstale":"2024-09-16T07:52:53.974337+0000","last_undegraded":"2024-09-16T07:52:53.974337+0000","last_fullsized":"2024-09-16T07:52:53.974337+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:53.988040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:53.988040+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1","version":"239'7","reported_seq":1475,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-16T07:52:54.450803+0000","last_change":"2024-09-16T07:52:54.469963+0000","last_active":"2024-09-16T07:52:54.450803+0000","last_peered":"2024-09-16T07:52:54.450803+0000","last_clean":"2024-09-16T07:52:54.450803+0000","last_became_active":"2024-09-16T07:38:56.517409+0000","last_became_peered":"2024-09-16T07:38:56.517409+0000","last_unstale":"2024-09-16T07:52:54.450803+0000","last_undegraded":"2024-09-16T07:52:54.450803+0000","last_fullsized":"2024-09-16T07:52:54.450803+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"239'7","last_scrub_stamp":"2024-09-16T07:52:54.469660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:54.469660+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.0","version":"0'0","reported_seq":1462,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-16T07:52:54.917861+0000","last_change":"2024-09-16T07:52:54.937108+0000","last_active":"2024-09-16T07:52:54.917861+0000","last_peered":"2024-09-16T07:52:54.917861+0000","last_clean":"2024-09-16T07:52:54.917861+0000","last_became_active":"2024-09-16T07:38:56.499378+0000","last_became_peered":"2024-09-16T07:38:56.499378+0000","last_unstale":"2024-09-16T07:52:54.917861+0000","last_undegraded":"2024-09-16T07:52:54.917861+0000","last_fullsized":"2024-09-16T07:52:54.917861+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":238,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:54.936922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:54.936922+0000","last_clean_scrub_stamp":"2024-09-16T07:38:55.399381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":2141,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-16T07:52:54.447407+0000","last_change":"2024-09-16T07:52:54.471664+0000","last_active":"2024-09-16T07:52:54.447407+0000","last_peered":"2024-09-16T07:52:54.447407+0000","last_clean":"2024-09-16T07:52:54.447407+0000","last_became_active":"2024-09-16T07:33:53.988604+0000","last_became_peered":"2024-09-16T07:33:53.988604+0000","last_unstale":"2024-09-16T07:52:54.447407+0000","last_undegraded":"2024-09-16T07:52:54.447407+0000","last_fullsized":"2024-09-16T07:52:54.447407+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:54.471394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:54.471394+0000","last_clean_scrub_stamp":"2024-09-16T07:33:52.925999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":2141,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-16T07:52:54.916220+0000","last_change":"2024-09-16T07:52:54.930943+0000","last_active":"2024-09-16T07:52:54.916220+0000","last_peered":"2024-09-16T07:52:54.916220+0000","last_clean":"2024-09-16T07:52:54.916220+0000","last_became_active":"2024-09-16T07:33:53.999244+0000","last_became_peered":"2024-09-16T07:33:53.999244+0000","last_unstale":"2024-09-16T07:52:54.916220+0000","last_undegraded":"2024-09-16T07:52:54.916220+0000","last_fullsized":"2024-09-16T07:52:54.916220+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:54.930731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:54.930731+0000","last_clean_scrub_stamp":"2024-09-16T07:33:52.925999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":2141,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-16T07:52:55.373435+0000","last_change":"2024-09-16T07:52:55.400025+0000","last_active":"2024-09-16T07:52:55.373435+0000","last_peered":"2024-09-16T07:52:55.373435+0000","last_clean":"2024-09-16T07:52:55.373435+0000","last_became_active":"2024-09-16T07:33:54.001528+0000","last_became_peered":"2024-09-16T07:33:54.001528+0000","last_unstale":"2024-09-16T07:52:55.373435+0000","last_undegraded":"2024-09-16T07:52:55.373435+0000","last_fullsized":"2024-09-16T07:52:55.373435+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:55.399746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:55.399746+0000","last_clean_scrub_stamp":"2024-09-16T07:33:52.925999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":2141,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-16T07:52:54.914411+0000","last_change":"2024-09-16T07:52:54.927207+0000","last_active":"2024-09-16T07:52:54.914411+0000","last_peered":"2024-09-16T07:52:54.914411+0000","last_clean":"2024-09-16T07:52:54.914411+0000","last_became_active":"2024-09-16T07:33:53.989047+0000","last_became_peered":"2024-09-16T07:33:53.989047+0000","last_unstale":"2024-09-16T07:52:54.914411+0000","last_undegraded":"2024-09-16T07:52:54.914411+0000","last_fullsized":"2024-09-16T07:52:54.914411+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:54.926922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:54.926922+0000","last_clean_scrub_stamp":"2024-09-16T07:33:52.925999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":2143,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-16T07:52:53.975260+0000","last_change":"2024-09-16T07:52:54.006532+0000","last_active":"2024-09-16T07:52:53.975260+0000","last_peered":"2024-09-16T07:52:53.975260+0000","last_clean":"2024-09-16T07:52:53.975260+0000","last_became_active":"2024-09-16T07:33:53.989661+0000","last_became_peered":"2024-09-16T07:33:53.989661+0000","last_unstale":"2024-09-16T07:52:53.975260+0000","last_undegraded":"2024-09-16T07:52:53.975260+0000","last_fullsized":"2024-09-16T07:52:53.975260+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"15'2","last_scrub_stamp":"2024-09-16T07:52:54.006366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:54.006366+0000","last_clean_scrub_stamp":"2024-09-16T07:33:52.925999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":2141,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-16T07:52:54.446094+0000","last_change":"2024-09-16T07:52:54.460717+0000","last_active":"2024-09-16T07:52:54.446094+0000","last_peered":"2024-09-16T07:52:54.446094+0000","last_clean":"2024-09-16T07:52:54.446094+0000","last_became_active":"2024-09-16T07:33:54.001165+0000","last_became_peered":"2024-09-16T07:33:54.001165+0000","last_unstale":"2024-09-16T07:52:54.446094+0000","last_undegraded":"2024-09-16T07:52:54.446094+0000","last_fullsized":"2024-09-16T07:52:54.446094+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:54.460553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:54.460553+0000","last_clean_scrub_stamp":"2024-09-16T07:33:52.925999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":2141,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-16T07:52:53.975275+0000","last_change":"2024-09-16T07:52:54.002003+0000","last_active":"2024-09-16T07:52:53.975275+0000","last_peered":"2024-09-16T07:52:53.975275+0000","last_clean":"2024-09-16T07:52:53.975275+0000","last_became_active":"2024-09-16T07:33:53.998493+0000","last_became_peered":"2024-09-16T07:33:53.998493+0000","last_unstale":"2024-09-16T07:52:53.975275+0000","last_undegraded":"2024-09-16T07:52:53.975275+0000","last_fullsized":"2024-09-16T07:52:53.975275+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:54.001733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:54.001733+0000","last_clean_scrub_stamp":"2024-09-16T07:33:52.925999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":2142,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-16T07:52:54.447853+0000","last_change":"2024-09-16T07:52:54.480503+0000","last_active":"2024-09-16T07:52:54.447853+0000","last_peered":"2024-09-16T07:52:54.447853+0000","last_clean":"2024-09-16T07:52:54.447853+0000","last_became_active":"2024-09-16T07:33:54.007370+0000","last_became_peered":"2024-09-16T07:33:54.007370+0000","last_unstale":"2024-09-16T07:52:54.447853+0000","last_undegraded":"2024-09-16T07:52:54.447853+0000","last_fullsized":"2024-09-16T07:52:54.447853+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"13'1","last_scrub_stamp":"2024-09-16T07:52:54.480338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:54.480338+0000","last_clean_scrub_stamp":"2024-09-16T07:33:52.925999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":2213,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-16T07:52:55.373389+0000","last_change":"2024-09-16T07:52:55.418875+0000","last_active":"2024-09-16T07:52:55.373389+0000","last_peered":"2024-09-16T07:52:55.373389+0000","last_clean":"2024-09-16T07:52:55.373389+0000","last_became_active":"2024-09-16T07:33:51.963446+0000","last_became_peered":"2024-09-16T07:33:51.963446+0000","last_unstale":"2024-09-16T07:52:55.373389+0000","last_undegraded":"2024-09-16T07:52:55.373389+0000","last_fullsized":"2024-09-16T07:52:55.373389+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"11'52","last_scrub_stamp":"2024-09-16T07:52:55.418652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:55.418652+0000","last_clean_scrub_stamp":"2024-09-16T07:33:50.923539+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":75,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30044,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706833,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":63252,"kb_used_data":1732,"kb_used_omap":0,"kb_used_meta":61504,"kb_avail":94308588,"statfs":{"total":96636764160,"available":96571994112,"internally_reserved":0,"allocated":1773568,"data_stored":1097916,"data_compressed":30044,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":62980096},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706833,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":64608,"kb_used_data":1680,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94307232,"statfs":{"total":96636764160,"available":96570605568,"internally_reserved":0,"allocated":1720320,"data_stored":507572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706833,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59036,"kb_used_data":1676,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94312804,"statfs":{"total":96636764160,"available":96576311296,"internally_reserved":0,"allocated":1716224,"data_stored":507553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706833,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":68824,"kb_used_data":1736,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94303016,"statfs":{"total":96636764160,"available":96566288384,"internally_reserved":0,"allocated":1777664,"data_stored":1097935,"data_compressed":30044,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30044,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:53:36.364 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-16T07:53:36.473 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.467+0000 7f5aac991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:36.474 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.475+0000 7f5aac991640 1 Processor -- start 2024-09-16T07:53:36.474 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.475+0000 7f5aac991640 1 -- start start 2024-09-16T07:53:36.476 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.476+0000 7f5aac991640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f5aa812f420 0x7f5aa812f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:53:36.476 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.476+0000 7f5aac991640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5aa809e5d0 con 0x7f5aa812fd70 2024-09-16T07:53:36.476 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.476+0000 7f5aac991640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f5aa806fc10 con 0x7f5aa812f420 2024-09-16T07:53:36.477 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.477+0000 7f5aa659c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f5aa812f420 0x7f5aa812f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:53:36.477 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.477+0000 7f5aa659c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f5aa812f420 0x7f5aa812f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:49254/0 (socket says 172.21.15.121:49254) 2024-09-16T07:53:36.477 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.477+0000 7f5aa659c640 1 -- 172.21.15.121:0/1351851013 learned_addr learned my addr 172.21.15.121:0/1351851013 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:53:36.477 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.477+0000 7f5aa5d9b640 1 --1- 172.21.15.121:0/1351851013 >> v1:172.21.15.121:6789/0 conn(0x7f5aa812fd70 0x7f5aa809c800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:52258/0 (socket says 172.21.15.121:52258) 2024-09-16T07:53:36.477 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.477+0000 7f5aa659c640 1 -- 172.21.15.121:0/1351851013 >> v1:172.21.15.121:6789/0 conn(0x7f5aa812fd70 legacy=0x7f5aa809c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:53:36.477 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.477+0000 7f5aa559a640 1 -- 172.21.15.121:0/1351851013 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3834257598 0 0) 0x7f5aa809e5d0 con 0x7f5aa812fd70 2024-09-16T07:53:36.477 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.477+0000 7f5aa659c640 1 -- 172.21.15.121:0/1351851013 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5aa806f170 con 0x7f5aa812f420 2024-09-16T07:53:36.477 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.477+0000 7f5aa659c640 1 --2- 172.21.15.121:0/1351851013 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5aa812f420 0x7f5aa812f830 crc :-1 s=READY pgs=13038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=979c9e8a78691a98 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:53:36.477 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.477+0000 7f5aa559a640 1 -- 172.21.15.121:0/1351851013 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5a9800e040 con 0x7f5aa812f420 2024-09-16T07:53:36.477 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.477+0000 7f5aa559a640 1 -- 172.21.15.121:0/1351851013 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f5a980091e0 con 0x7f5aa812f420 2024-09-16T07:53:36.477 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.477+0000 7f5aa559a640 1 -- 172.21.15.121:0/1351851013 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5a98007730 con 0x7f5aa812f420 2024-09-16T07:53:36.483 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.478+0000 7f5aac991640 1 -- 172.21.15.121:0/1351851013 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5aa812f420 msgr2=0x7f5aa812f830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:53:36.483 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.478+0000 7f5aac991640 1 --2- 172.21.15.121:0/1351851013 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5aa812f420 0x7f5aa812f830 crc :-1 s=READY pgs=13038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:53:36.483 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.478+0000 7f5aac991640 1 -- 172.21.15.121:0/1351851013 shutdown_connections 2024-09-16T07:53:36.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.478+0000 7f5aac991640 1 --2- 172.21.15.121:0/1351851013 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5aa812f420 0x7f5aa812f830 unknown :-1 s=CLOSED pgs=13038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:53:36.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.478+0000 7f5aac991640 1 -- 172.21.15.121:0/1351851013 >> 172.21.15.121:0/1351851013 conn(0x7f5aa80a1260 msgr2=0x7f5aa80a1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:53:36.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.478+0000 7f5aac991640 1 -- 172.21.15.121:0/1351851013 shutdown_connections 2024-09-16T07:53:36.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.478+0000 7f5aac991640 1 -- 172.21.15.121:0/1351851013 wait complete. 2024-09-16T07:53:36.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.478+0000 7f5aac991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:36.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.480+0000 7f5aac991640 1 Processor -- start 2024-09-16T07:53:36.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.480+0000 7f5aac991640 1 -- start start 2024-09-16T07:53:36.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.481+0000 7f5aac991640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5aa812f420 0x7f5aa8073320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:53:36.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.481+0000 7f5aac991640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5aa812ead0 con 0x7f5aa812f420 2024-09-16T07:53:36.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.481+0000 7f5aa659c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5aa812f420 0x7f5aa8073320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:53:36.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.481+0000 7f5aa659c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5aa812f420 0x7f5aa8073320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:49258/0 (socket says 172.21.15.121:49258) 2024-09-16T07:53:36.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.481+0000 7f5aa659c640 1 -- 172.21.15.121:0/1511646208 learned_addr learned my addr 172.21.15.121:0/1511646208 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-16T07:53:36.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.481+0000 7f5aa659c640 1 -- 172.21.15.121:0/1511646208 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5aa812a860 con 0x7f5aa812f420 2024-09-16T07:53:36.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.481+0000 7f5aa659c640 1 --2- 172.21.15.121:0/1511646208 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5aa812f420 0x7f5aa8073320 crc :-1 s=READY pgs=13039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:53:36.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.481+0000 7f5a9effd640 1 -- 172.21.15.121:0/1511646208 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5a9800e040 con 0x7f5aa812f420 2024-09-16T07:53:36.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.481+0000 7f5a9effd640 1 -- 172.21.15.121:0/1511646208 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f5a980094d0 con 0x7f5aa812f420 2024-09-16T07:53:36.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.481+0000 7f5aac991640 1 -- 172.21.15.121:0/1511646208 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5aa809a330 con 0x7f5aa812f420 2024-09-16T07:53:36.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.481+0000 7f5a9effd640 1 -- 172.21.15.121:0/1511646208 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5a98011920 con 0x7f5aa812f420 2024-09-16T07:53:36.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.482+0000 7f5aac991640 1 -- 172.21.15.121:0/1511646208 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5aa812b4e0 con 0x7f5aa812f420 2024-09-16T07:53:36.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.482+0000 7f5a9effd640 1 -- 172.21.15.121:0/1511646208 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f5a98011ad0 con 0x7f5aa812f420 2024-09-16T07:53:36.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.483+0000 7f5a9effd640 1 --2- 172.21.15.121:0/1511646208 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f5a8803e930 0x7f5a88040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:53:36.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.483+0000 7f5a9effd640 1 -- 172.21.15.121:0/1511646208 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(723..723 src has 620..723) ==== 3431+0+0 (crc 0 0 0) 0x7f5a98050e70 con 0x7f5aa812f420 2024-09-16T07:53:36.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.483+0000 7f5aac991640 1 -- 172.21.15.121:0/1511646208 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5aa809a330 con 0x7f5aa812f420 2024-09-16T07:53:36.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.483+0000 7f5aa5d9b640 1 --2- 172.21.15.121:0/1511646208 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f5a8803e930 0x7f5a88040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:53:36.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.483+0000 7f5aa5d9b640 1 --2- 172.21.15.121:0/1511646208 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f5a8803e930 0x7f5a88040e40 crc :-1 s=READY pgs=3859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:53:36.487 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.488+0000 7f5a9effd640 1 -- 172.21.15.121:0/1511646208 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f5aa809a330 con 0x7f5aa812f420 2024-09-16T07:53:36.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.668+0000 7f5aac991640 1 -- 172.21.15.121:0/1511646208 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f5aa809a330 con 0x7f5aa812f420 2024-09-16T07:53:36.670 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.671+0000 7f5a9effd640 1 -- 172.21.15.121:0/1511646208 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v2)=0 v2) ==== 123+0+0 (crc 0 0 0) 0x7f5aa809a330 con 0x7f5aa812f420 2024-09-16T07:53:36.671 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.672+0000 7f5a9effd640 1 -- 172.21.15.121:0/1511646208 <== mon.0 v2:172.21.15.121:3300/0 8 ==== config(1 keys) ==== 35+0+0 (crc 0 0 0) 0x7f5a9800e1a0 con 0x7f5aa812f420 2024-09-16T07:53:36.673 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.674+0000 7f5aac991640 1 -- 172.21.15.121:0/1511646208 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f5a8803e930 msgr2=0x7f5a88040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:53:36.673 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.674+0000 7f5aac991640 1 --2- 172.21.15.121:0/1511646208 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f5a8803e930 0x7f5a88040e40 crc :-1 s=READY pgs=3859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:53:36.673 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.674+0000 7f5aac991640 1 -- 172.21.15.121:0/1511646208 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5aa812f420 msgr2=0x7f5aa8073320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:53:36.674 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.674+0000 7f5aac991640 1 --2- 172.21.15.121:0/1511646208 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5aa812f420 0x7f5aa8073320 crc :-1 s=READY pgs=13039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:53:36.674 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.674+0000 7f5aac991640 1 -- 172.21.15.121:0/1511646208 shutdown_connections 2024-09-16T07:53:36.674 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.674+0000 7f5aac991640 1 --2- 172.21.15.121:0/1511646208 >> [v2:172.21.15.172:6800/643901738,v1:172.21.15.172:6801/643901738] conn(0x7f5a8803e930 0x7f5a88040e40 unknown :-1 s=CLOSED pgs=3859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:53:36.674 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.674+0000 7f5aac991640 1 --2- 172.21.15.121:0/1511646208 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5aa812f420 0x7f5aa8073320 unknown :-1 s=CLOSED pgs=13039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:53:36.674 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.674+0000 7f5aac991640 1 -- 172.21.15.121:0/1511646208 >> 172.21.15.121:0/1511646208 conn(0x7f5aa80a1260 msgr2=0x7f5aa80a2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:53:36.674 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.674+0000 7f5aac991640 1 -- 172.21.15.121:0/1511646208 shutdown_connections 2024-09-16T07:53:36.674 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-16T07:53:36.674+0000 7f5aac991640 1 -- 172.21.15.121:0/1511646208 wait complete. 2024-09-16T07:53:36.690 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-16T07:53:36.690 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-16T07:53:36.691 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-16T07:53:36.691 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:53:36.771 INFO:tasks.ceph.osd.0:Stopped 2024-09-16T07:53:36.772 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-16T07:53:36.772 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:53:36.842 INFO:tasks.ceph.osd.1:Stopped 2024-09-16T07:53:36.842 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-16T07:53:36.842 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:53:36.918 INFO:tasks.ceph.osd.2:Stopped 2024-09-16T07:53:36.919 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-16T07:53:36.919 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:53:36.996 INFO:tasks.ceph.osd.3:Stopped 2024-09-16T07:53:36.996 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-16T07:53:36.996 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-16T07:53:36.996 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:53:37.025 INFO:tasks.ceph.mgr.x:Stopped 2024-09-16T07:53:37.025 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-16T07:53:37.025 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-16T07:53:37.025 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:53:37.040 INFO:tasks.ceph.mon.a:Stopped 2024-09-16T07:53:37.040 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-16T07:53:37.040 DEBUG:teuthology.orchestra.run.smithi121:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'reached quota' | egrep -v 'but it is still running' | egrep -v 'overall HEALTH_' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | head -n 1 2024-09-16T07:53:37.115 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi121.front.sepia.ceph.com 2024-09-16T07:53:37.116 DEBUG:teuthology.orchestra.run.smithi121:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-16T07:53:37.289 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi121.front.sepia.ceph.com 2024-09-16T07:53:37.290 DEBUG:teuthology.orchestra.run.smithi121:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-16T07:53:37.394 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi172.front.sepia.ceph.com 2024-09-16T07:53:37.394 DEBUG:teuthology.orchestra.run.smithi172:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-16T07:53:37.507 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi172.front.sepia.ceph.com 2024-09-16T07:53:37.508 DEBUG:teuthology.orchestra.run.smithi172:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-16T07:53:37.585 INFO:tasks.ceph:Archiving mon data... 2024-09-16T07:53:37.587 DEBUG:teuthology.misc:Transferring archived files from smithi121:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/matan-2024-09-16_07:15:55-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7906859/data/mon.a.tgz 2024-09-16T07:53:37.587 DEBUG:teuthology.orchestra.run.smithi121:> mktemp 2024-09-16T07:53:37.603 INFO:teuthology.orchestra.run.smithi121.stdout:/tmp/tmp.UJUbazOg9f 2024-09-16T07:53:37.603 DEBUG:teuthology.orchestra.run.smithi121:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.UJUbazOg9f 2024-09-16T07:53:37.733 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 0666 /tmp/tmp.UJUbazOg9f 2024-09-16T07:53:37.817 DEBUG:teuthology.orchestra.remote:smithi121:/tmp/tmp.UJUbazOg9f is 289KB 2024-09-16T07:53:37.917 DEBUG:teuthology.orchestra.run.smithi121:> rm -fr /tmp/tmp.UJUbazOg9f 2024-09-16T07:53:37.932 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-16T07:53:37.932 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-16T07:53:37.974 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-16T07:53:38.053 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-16T07:53:38.070 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-16T07:53:38.070 INFO:tasks.ceph:Archiving crash dumps... 2024-09-16T07:53:38.072 DEBUG:teuthology.misc:Transferring archived files from smithi121:/var/lib/ceph/crash to /home/teuthworker/archive/matan-2024-09-16_07:15:55-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7906859/remote/smithi121/crash 2024-09-16T07:53:38.073 DEBUG:teuthology.orchestra.run.smithi121:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-16T07:53:38.118 DEBUG:teuthology.misc:Transferring archived files from smithi172:/var/lib/ceph/crash to /home/teuthworker/archive/matan-2024-09-16_07:15:55-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7906859/remote/smithi172/crash 2024-09-16T07:53:38.119 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-16T07:53:38.181 INFO:tasks.ceph:Compressing logs... 2024-09-16T07:53:38.182 DEBUG:teuthology.orchestra.run.smithi121:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-16T07:53:38.185 DEBUG:teuthology.orchestra.run.smithi172:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-16T07:53:38.206 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-16T07:53:38.206 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96164.log 2024-09-16T07:53:38.216 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28160.log 2024-09-16T07:53:38.216 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28120.log 2024-09-16T07:53:38.216 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-16T07:53:38.217 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.28160.log: /var/log/ceph/ceph-client.admin.28120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28251.log 2024-09-16T07:53:38.217 INFO:teuthology.orchestra.run.smithi172.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.28160.log.gz 2024-09-16T07:53:38.217 INFO:teuthology.orchestra.run.smithi172.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.28120.log.gz 2024-09-16T07:53:38.217 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-16T07:53:38.217 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.28251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28211.log 2024-09-16T07:53:38.217 INFO:teuthology.orchestra.run.smithi172.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.28251.log.gz 2024-09-16T07:53:38.217 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-16T07:53:38.217 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.28211.log: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.28211.log.gz 2024-09-16T07:53:38.256 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94917.log 2024-09-16T07:53:38.256 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.96164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29313.log 2024-09-16T07:53:38.256 INFO:teuthology.orchestra.run.smithi121.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.96164.log.gz 2024-09-16T07:53:38.256 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.94917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94171.log 2024-09-16T07:53:38.256 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.29313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94395.log 2024-09-16T07:53:38.257 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.94171.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.29313.log.gz 2024-09-16T07:53:38.257 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97069.log 2024-09-16T07:53:38.257 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31141.log 2024-09-16T07:53:38.257 INFO:teuthology.orchestra.run.smithi121.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.94171.log.gz 2024-09-16T07:53:38.257 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.94395.log: /var/log/ceph/ceph-client.admin.97069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96589.log 2024-09-16T07:53:38.257 INFO:teuthology.orchestra.run.smithi121.stderr: 85.7%/var/log/ceph/ceph-client.admin.31141.log: -- replaced with /var/log/ceph/ceph-client.admin.97069.log.gz 2024-09-16T07:53:38.257 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29172.log 2024-09-16T07:53:38.257 INFO:teuthology.orchestra.run.smithi121.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.94395.log.gz 2024-09-16T07:53:38.257 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28719.log 2024-09-16T07:53:38.257 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.96589.log: /var/log/ceph/ceph-client.admin.29172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95837.log 2024-09-16T07:53:38.257 INFO:teuthology.orchestra.run.smithi121.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.31141.log.gz 2024-09-16T07:53:38.257 INFO:teuthology.orchestra.run.smithi121.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.96589.log.gz 2024-09-16T07:53:38.257 INFO:teuthology.orchestra.run.smithi121.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.29172.log.gz 2024-09-16T07:53:38.257 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.28719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94150.log 2024-09-16T07:53:38.258 INFO:teuthology.orchestra.run.smithi121.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.28719.log.gz 2024-09-16T07:53:38.258 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29483.log 2024-09-16T07:53:38.258 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.95837.log: /var/log/ceph/ceph-client.admin.94150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94169.log 2024-09-16T07:53:38.258 INFO:teuthology.orchestra.run.smithi121.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.95837.log.gz 2024-09-16T07:53:38.258 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.29483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31309.log 2024-09-16T07:53:38.258 INFO:teuthology.orchestra.run.smithi121.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.29483.log.gz 2024-09-16T07:53:38.258 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.94169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94497.log 2024-09-16T07:53:38.258 INFO:teuthology.orchestra.run.smithi121.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.94169.log.gz 2024-09-16T07:53:38.258 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.31309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96817.log 2024-09-16T07:53:38.258 INFO:teuthology.orchestra.run.smithi121.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.94150.log.gz 2024-09-16T07:53:38.258 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-16T07:53:38.258 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.94497.log: /var/log/ceph/ceph-client.admin.96817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94023.log 2024-09-16T07:53:38.258 INFO:teuthology.orchestra.run.smithi121.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.94917.log.gz 2024-09-16T07:53:38.258 INFO:teuthology.orchestra.run.smithi121.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.96817.log.gz 2024-09-16T07:53:38.259 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95929.log 2024-09-16T07:53:38.259 INFO:teuthology.orchestra.run.smithi121.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.94497.log.gz 2024-09-16T07:53:38.259 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93415.log 2024-09-16T07:53:38.259 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.94023.log: /var/log/ceph/ceph-client.admin.95929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94258.log 2024-09-16T07:53:38.259 INFO:teuthology.orchestra.run.smithi121.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.95929.log.gz 2024-09-16T07:53:38.259 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.93415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97237.log 2024-09-16T07:53:38.259 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5/var/log/ceph/ceph-client.admin.94258.log: --verbose -- /var/log/ceph/ceph-client.admin.96504.log 2024-09-16T07:53:38.259 INFO:teuthology.orchestra.run.smithi121.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.93415.log.gz/var/log/ceph/ceph-client.admin.97237.log: 2024-09-16T07:53:38.259 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97027.log 2024-09-16T07:53:38.259 INFO:teuthology.orchestra.run.smithi121.stderr: 90.6% 85.3% -- replaced with /var/log/ceph/ceph-client.admin.97237.log.gz 2024-09-16T07:53:38.259 INFO:teuthology.orchestra.run.smithi121.stderr: -- replaced with /var/log/ceph/ceph-client.admin.94258.log.gz 2024-09-16T07:53:38.259 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28455.log 2024-09-16T07:53:38.259 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.96504.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96504.log.gz 2024-09-16T07:53:38.259 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.97027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29315.log 2024-09-16T07:53:38.260 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.28455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95887.log 2024-09-16T07:53:38.260 INFO:teuthology.orchestra.run.smithi121.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.97027.log.gz 2024-09-16T07:53:38.260 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.29315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96546.log 2024-09-16T07:53:38.260 INFO:teuthology.orchestra.run.smithi121.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.28455.log.gz 2024-09-16T07:53:38.260 INFO:teuthology.orchestra.run.smithi121.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.29315.log.gz 2024-09-16T07:53:38.260 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28691.log 2024-09-16T07:53:38.260 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.95887.log: /var/log/ceph/ceph-client.admin.96546.log: gzip -5 --verbose 87.8% -- replaced with /var/log/ceph/ceph-client.admin.95887.log.gz 2024-09-16T07:53:38.260 INFO:teuthology.orchestra.run.smithi121.stderr: -- /var/log/ceph/ceph-client.admin.96420.log 2024-09-16T07:53:38.260 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.28691.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96546.log.gz 2024-09-16T07:53:38.260 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95992.log 2024-09-16T07:53:38.260 INFO:teuthology.orchestra.run.smithi121.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.28691.log.gz 2024-09-16T07:53:38.260 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.96420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95146.log 2024-09-16T07:53:38.260 INFO:teuthology.orchestra.run.smithi121.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96420.log.gz 2024-09-16T07:53:38.260 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.95992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29895.log 2024-09-16T07:53:38.261 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5/var/log/ceph/ceph-client.admin.95146.log: 87.7% --verbose -- /var/log/ceph/ceph-client.admin.29214.log 2024-09-16T07:53:38.261 INFO:teuthology.orchestra.run.smithi121.stderr: -- replaced with /var/log/ceph/ceph-client.admin.95992.log.gz 2024-09-16T07:53:38.261 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.29895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96483.log/var/log/ceph/ceph-client.admin.29214.log: 2024-09-16T07:53:38.261 INFO:teuthology.orchestra.run.smithi121.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.29214.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31290.log 2024-09-16T07:53:38.261 INFO:teuthology.orchestra.run.smithi121.stderr: 2024-09-16T07:53:38.261 INFO:teuthology.orchestra.run.smithi121.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.95146.log.gz 2024-09-16T07:53:38.261 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.96483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97195.log 2024-09-16T07:53:38.261 INFO:teuthology.orchestra.run.smithi121.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.96483.log.gz 2024-09-16T07:53:38.261 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.31290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96191.log 2024-09-16T07:53:38.261 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.97195.log: 89.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93434.log 2024-09-16T07:53:38.261 INFO:teuthology.orchestra.run.smithi121.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31290.log.gz 2024-09-16T07:53:38.261 INFO:teuthology.orchestra.run.smithi121.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.97195.log.gz 2024-09-16T07:53:38.261 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.96191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29316.log 2024-09-16T07:53:38.261 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.93434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94170.log 2024-09-16T07:53:38.262 INFO:teuthology.orchestra.run.smithi121.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.96191.log.gz 2024-09-16T07:53:38.262 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.29316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94393.log 87.9% -- replaced with /var/log/ceph/ceph-client.admin.93434.log.gz 2024-09-16T07:53:38.262 INFO:teuthology.orchestra.run.smithi121.stderr: 2024-09-16T07:53:38.262 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.94170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94208.log 2024-09-16T07:53:38.262 INFO:teuthology.orchestra.run.smithi121.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.29316.log.gz 2024-09-16T07:53:38.262 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.94393.log: gzip -5 93.0% -- replaced with /var/log/ceph/ceph-client.admin.94023.log.gz 2024-09-16T07:53:38.262 INFO:teuthology.orchestra.run.smithi121.stderr: --verbose -- /var/log/ceph/ceph-client.admin.96638.log 2024-09-16T07:53:38.262 INFO:teuthology.orchestra.run.smithi121.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.94170.log.gz 2024-09-16T07:53:38.262 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 88.3% -- replaced with /var/log/ceph/ceph-client.admin.94393.log.gz 2024-09-16T07:53:38.262 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.94208.log: --verbose -- /var/log/ceph/ceph.audit.log 2024-09-16T07:53:38.262 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.96638.log: gzip 92.3% -- replaced with /var/log/ceph/ceph-client.admin.29895.log.gz 2024-09-16T07:53:38.262 INFO:teuthology.orchestra.run.smithi121.stderr: -5 --verbose -- 86.2% -- replaced with /var/log/ceph/ceph-client.admin.96638.log.gz 2024-09-16T07:53:38.262 INFO:teuthology.orchestra.run.smithi121.stderr: /var/log/ceph/ceph-client.admin.96943.log 2024-09-16T07:53:38.262 INFO:teuthology.orchestra.run.smithi121.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.94208.log.gz 2024-09-16T07:53:38.263 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28948.log 2024-09-16T07:53:38.263 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.96943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29314.log 2024-09-16T07:53:38.263 INFO:teuthology.orchestra.run.smithi121.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.96943.log.gz 2024-09-16T07:53:38.263 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.28948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95971.log 2024-09-16T07:53:38.263 INFO:teuthology.orchestra.run.smithi121.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.28948.log.gz 2024-09-16T07:53:38.263 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.29314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93027.log 2024-09-16T07:53:38.263 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.95971.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.29314.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29484.log 2024-09-16T07:53:38.263 INFO:teuthology.orchestra.run.smithi121.stderr: 2024-09-16T07:53:38.263 INFO:teuthology.orchestra.run.smithi121.stderr: 89.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-16T07:53:38.263 INFO:teuthology.orchestra.run.smithi121.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.95971.log.gz 2024-09-16T07:53:38.263 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.93027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94206.log 2024-09-16T07:53:38.263 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.29484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94310.log 2024-09-16T07:53:38.263 INFO:teuthology.orchestra.run.smithi121.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.93027.log.gz 2024-09-16T07:53:38.263 INFO:teuthology.orchestra.run.smithi121.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.29484.log.gz 2024-09-16T07:53:38.263 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.94206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95862.log 2024-09-16T07:53:38.264 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96281.log 2024-09-16T07:53:38.264 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.94310.log: /var/log/ceph/ceph-client.admin.95862.log: gzip -5 --verbose 88.6% -- replaced with /var/log/ceph/ceph-client.admin.94206.log.gz 2024-09-16T07:53:38.264 INFO:teuthology.orchestra.run.smithi121.stderr: -- /var/log/ceph/ceph-client.admin.94394.log 2024-09-16T07:53:38.264 INFO:teuthology.orchestra.run.smithi121.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.95862.log.gz 2024-09-16T07:53:38.264 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.96281.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.94310.log.gz 2024-09-16T07:53:38.264 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93472.log 2024-09-16T07:53:38.264 INFO:teuthology.orchestra.run.smithi121.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.96281.log.gz 2024-09-16T07:53:38.264 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.94394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96076.log 2024-09-16T07:53:38.264 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.93472.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.94394.log.gz 2024-09-16T07:53:38.264 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93067.log 2024-09-16T07:53:38.264 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94570.log 2024-09-16T07:53:38.264 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.96076.log: /var/log/ceph/ceph-client.admin.93067.log: gzip 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96076.log.gz 2024-09-16T07:53:38.264 INFO:teuthology.orchestra.run.smithi121.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.96662.log 2024-09-16T07:53:38.264 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.94570.log: 91.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96859.log 2024-09-16T07:53:38.265 INFO:teuthology.orchestra.run.smithi121.stderr: -- replaced with /var/log/ceph/ceph-client.admin.93472.log.gz 2024-09-16T07:53:38.265 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.96662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94572.log 2024-09-16T07:53:38.265 INFO:teuthology.orchestra.run.smithi121.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.94570.log.gz 2024-09-16T07:53:38.265 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.96859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29482.log 2024-09-16T07:53:38.265 INFO:teuthology.orchestra.run.smithi121.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.96662.log.gz 2024-09-16T07:53:38.265 INFO:teuthology.orchestra.run.smithi121.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.96859.log.gz 2024-09-16T07:53:38.265 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94498.log 2024-09-16T07:53:38.265 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.94572.log: /var/log/ceph/ceph-client.admin.29482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94461.log 2024-09-16T07:53:38.265 INFO:teuthology.orchestra.run.smithi121.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.93067.log.gz 2024-09-16T07:53:38.265 INFO:teuthology.orchestra.run.smithi121.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.29482.log.gz 2024-09-16T07:53:38.265 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.94498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28534.log 2024-09-16T07:53:38.265 INFO:teuthology.orchestra.run.smithi121.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.94572.log.gz 2024-09-16T07:53:38.265 INFO:teuthology.orchestra.run.smithi121.stderr:gzip 86.1% -- replaced with /var/log/ceph/ceph-client.admin.94498.log.gz 2024-09-16T07:53:38.266 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.94461.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.96378.log 2024-09-16T07:53:38.266 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.28534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29004.log 2024-09-16T07:53:38.266 INFO:teuthology.orchestra.run.smithi121.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.28534.log.gz 2024-09-16T07:53:38.266 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.96378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97279.log 2024-09-16T07:53:38.266 INFO:teuthology.orchestra.run.smithi121.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.94461.log.gz 2024-09-16T07:53:38.266 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31175.log 2024-09-16T07:53:38.266 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.29004.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96378.log.gz 2024-09-16T07:53:38.266 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.97279.log: 86.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.29004.log.gz -5 2024-09-16T07:53:38.266 INFO:teuthology.orchestra.run.smithi121.stderr: --verbose -- /var/log/ceph/ceph-client.admin.96307.log 2024-09-16T07:53:38.266 INFO:teuthology.orchestra.run.smithi121.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.97279.log.gz 2024-09-16T07:53:38.266 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93453.log 2024-09-16T07:53:38.266 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.31175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29130.log 2024-09-16T07:53:38.266 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.96307.log: /var/log/ceph/ceph-client.admin.93453.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.96307.log.gz 2024-09-16T07:53:38.266 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96098.log 2024-09-16T07:53:38.267 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.29130.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-16T07:53:38.267 INFO:teuthology.orchestra.run.smithi121.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.29130.log.gz 2024-09-16T07:53:38.267 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.96098.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.93453.log.gz 2024-09-16T07:53:38.267 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96143.log 2024-09-16T07:53:38.267 INFO:teuthology.orchestra.run.smithi121.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.96098.log.gz 2024-09-16T07:53:38.267 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97403.log 2024-09-16T07:53:38.267 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-mon.a.log: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.31175.log.gz 2024-09-16T07:53:38.267 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.96143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96462.log 2024-09-16T07:53:38.267 INFO:teuthology.orchestra.run.smithi121.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.96143.log.gz 2024-09-16T07:53:38.267 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.97403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29481.log 2024-09-16T07:53:38.267 INFO:teuthology.orchestra.run.smithi121.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.97403.log.gz 2024-09-16T07:53:38.267 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.96462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96568.log 2024-09-16T07:53:38.267 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.29481.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.96462.log.gz 2024-09-16T07:53:38.267 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94623.log 2024-09-16T07:53:38.268 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.96568.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.29481.log.gz 2024-09-16T07:53:38.268 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94534.log 2024-09-16T07:53:38.268 INFO:teuthology.orchestra.run.smithi121.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.96568.log.gz 2024-09-16T07:53:38.268 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.94623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94308.log 2024-09-16T07:53:38.268 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.94534.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.94623.log.gz 2024-09-16T07:53:38.268 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94259.log 2024-09-16T07:53:38.268 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.94308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96034.log 2024-09-16T07:53:38.268 INFO:teuthology.orchestra.run.smithi121.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.94534.log.gz 2024-09-16T07:53:38.268 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.94259.log: gzip -5 --verbose -- 88.6% -- replaced with /var/log/ceph/ceph-client.admin.94308.log.gz 2024-09-16T07:53:38.268 INFO:teuthology.orchestra.run.smithi121.stderr: /var/log/ceph/ceph-client.admin.96099.log 2024-09-16T07:53:38.268 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.96034.log: gzip -5 88.7% -- replaced with /var/log/ceph/ceph-client.admin.94259.log.gz 2024-09-16T07:53:38.268 INFO:teuthology.orchestra.run.smithi121.stderr: --verbose -- /var/log/ceph/ceph-client.admin.95466.log 2024-09-16T07:53:38.268 INFO:teuthology.orchestra.run.smithi121.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.96034.log.gz 2024-09-16T07:53:38.269 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.96099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94462.log 2024-09-16T07:53:38.269 INFO:teuthology.orchestra.run.smithi121.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.96099.log.gz 2024-09-16T07:53:38.269 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.95466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94688.log 2024-09-16T07:53:38.269 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.94462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96331.log 2024-09-16T07:53:38.269 INFO:teuthology.orchestra.run.smithi121.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.94462.log.gz 2024-09-16T07:53:38.269 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.94688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96613.log 2024-09-16T07:53:38.269 INFO:teuthology.orchestra.run.smithi121.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.94688.log.gz 2024-09-16T07:53:38.269 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93609.log 2024-09-16T07:53:38.269 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.96613.log: /var/log/ceph/ceph-client.admin.96331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93558.log 2024-09-16T07:53:38.269 INFO:teuthology.orchestra.run.smithi121.stderr: 86.7% 86.4% -- replaced with /var/log/ceph/ceph-client.admin.96331.log.gz 2024-09-16T07:53:38.269 INFO:teuthology.orchestra.run.smithi121.stderr: -- replaced with /var/log/ceph/ceph-client.admin.96613.log.gz 2024-09-16T07:53:38.269 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.93609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29676.log 2024-09-16T07:53:38.269 INFO:teuthology.orchestra.run.smithi121.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.95466.log.gz 2024-09-16T07:53:38.269 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92955.log 2024-09-16T07:53:38.270 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.93558.log: /var/log/ceph/ceph-client.admin.29676.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.29676.log.gz 2024-09-16T07:53:38.270 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94312.log 2024-09-16T07:53:38.270 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.92955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30364.log 2024-09-16T07:53:38.270 INFO:teuthology.orchestra.run.smithi121.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.93558.log.gz 2024-09-16T07:53:38.270 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.94312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94309.log 2024-09-16T07:53:38.270 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.30364.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.94312.log.gz 2024-09-16T07:53:38.270 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97363.log 2024-09-16T07:53:38.270 INFO:teuthology.orchestra.run.smithi121.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.93609.log.gz 2024-09-16T07:53:38.270 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.94309.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.94309.log.gz 2024-09-16T07:53:38.270 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95633.log 2024-09-16T07:53:38.270 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.97363.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-16T07:53:38.270 INFO:teuthology.orchestra.run.smithi121.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.97363.log.gz 2024-09-16T07:53:38.270 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94571.log 2024-09-16T07:53:38.271 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.95633.log: /var/log/ceph/ceph.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.95633.log.gz 2024-09-16T07:53:38.271 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97153.log 2024-09-16T07:53:38.271 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.94571.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.94571.log.gz 2024-09-16T07:53:38.271 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.27391.log 2024-09-16T07:53:38.271 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.97153.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.97153.log.gz 2024-09-16T07:53:38.271 INFO:teuthology.orchestra.run.smithi121.stderr: 88.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-16T07:53:38.271 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31271.log 2024-09-16T07:53:38.271 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96055.log 2024-09-16T07:53:38.271 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph.tmp-client.admin.27391.log: 66.7% -- replaced with /var/log/ceph/ceph.tmp-client.admin.27391.log.gz 2024-09-16T07:53:38.271 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.31271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96235.log 2024-09-16T07:53:38.271 INFO:teuthology.orchestra.run.smithi121.stderr: 88.9%/var/log/ceph/ceph-client.admin.96055.log: -- replaced with /var/log/ceph/ceph-client.admin.31271.log.gz 2024-09-16T07:53:38.271 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93944.log 2024-09-16T07:53:38.271 INFO:teuthology.orchestra.run.smithi121.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.96055.log.gz 2024-09-16T07:53:38.272 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.96235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31233.log 2024-09-16T07:53:38.272 INFO:teuthology.orchestra.run.smithi121.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.96235.log.gz 2024-09-16T07:53:38.272 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.93944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29634.log 2024-09-16T07:53:38.272 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.31233.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.93944.log.gz 2024-09-16T07:53:38.272 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94311.log 2024-09-16T07:53:38.272 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.29634.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.29634.log.gz 2024-09-16T07:53:38.272 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95811.log 2024-09-16T07:53:38.272 INFO:teuthology.orchestra.run.smithi121.stderr: 95.1% -- replaced with /var/log/ceph/ceph-client.admin.92955.log.gz 2024-09-16T07:53:38.287 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.94311.log: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.30364.log.gz 2024-09-16T07:53:38.287 INFO:teuthology.orchestra.run.smithi121.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.94311.log.gz 2024-09-16T07:53:38.287 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97111.log 2024-09-16T07:53:38.287 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.95811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94640.log 2024-09-16T07:53:38.287 INFO:teuthology.orchestra.run.smithi121.stderr: 86.9%/var/log/ceph/ceph-client.admin.97111.log: -- replaced with /var/log/ceph/ceph-client.admin.95811.log.gz 2024-09-16T07:53:38.287 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94535.log 2024-09-16T07:53:38.287 INFO:teuthology.orchestra.run.smithi121.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.97111.log.gz 2024-09-16T07:53:38.287 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97321.log 2024-09-16T07:53:38.287 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.94640.log: /var/log/ceph/ceph-client.admin.94535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93491.log 2024-09-16T07:53:38.288 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.97321.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.94535.log.gz 2024-09-16T07:53:38.288 INFO:teuthology.orchestra.run.smithi121.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.97321.log.gz 2024-09-16T07:53:38.288 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96357.log 2024-09-16T07:53:38.288 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.93491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95908.log 2024-09-16T07:53:38.288 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.96357.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.94640.log.gz 2024-09-16T07:53:38.288 INFO:teuthology.orchestra.run.smithi121.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.96357.log.gz 2024-09-16T07:53:38.288 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94964.log 2024-09-16T07:53:38.288 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.95908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96190.log 2024-09-16T07:53:38.288 INFO:teuthology.orchestra.run.smithi121.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.95908.log.gz 2024-09-16T07:53:38.288 INFO:teuthology.orchestra.run.smithi121.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.93491.log.gz 2024-09-16T07:53:38.288 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.94964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96441.log 2024-09-16T07:53:38.288 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.96190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96901.log 2024-09-16T07:53:38.288 INFO:teuthology.orchestra.run.smithi121.stderr: 94.2% -- replaced with /var/log/ceph/ceph-client.admin.31233.log.gz 2024-09-16T07:53:38.289 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.96441.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.96190.log.gz 2024-09-16T07:53:38.289 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29037.log 2024-09-16T07:53:38.289 INFO:teuthology.orchestra.run.smithi121.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.96441.log.gz 2024-09-16T07:53:38.289 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.96901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95253.log 2024-09-16T07:53:38.289 INFO:teuthology.orchestra.run.smithi121.stderr: 86.0%/var/log/ceph/ceph-client.admin.29037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94257.log 2024-09-16T07:53:38.289 INFO:teuthology.orchestra.run.smithi121.stderr: -- replaced with /var/log/ceph/ceph-client.admin.96901.log.gz 2024-09-16T07:53:38.289 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.95253.log: 86.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96259.log 2024-09-16T07:53:38.289 INFO:teuthology.orchestra.run.smithi121.stderr: -- replaced with /var/log/ceph/ceph-client.admin.29037.log.gz 2024-09-16T07:53:38.289 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.94257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95665.log 2024-09-16T07:53:38.289 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.96259.log: 88.4% 88.0% -- replaced with /var/log/ceph/ceph-client.admin.96259.log.gz 2024-09-16T07:53:38.289 INFO:teuthology.orchestra.run.smithi121.stderr: -- replaced with /var/log/ceph/ceph-client.admin.94257.log.gz 2024-09-16T07:53:38.289 INFO:teuthology.orchestra.run.smithi121.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.94964.log.gz 2024-09-16T07:53:38.289 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93299.log 2024-09-16T07:53:38.290 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.95665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31194.log 2024-09-16T07:53:38.290 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.93299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29088.log 2024-09-16T07:53:38.290 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.31194.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.31194.log.gz 2024-09-16T07:53:38.290 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29592.log 2024-09-16T07:53:38.290 INFO:teuthology.orchestra.run.smithi121.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.95253.log.gz 2024-09-16T07:53:38.290 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.29088.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.29088.log.gz 2024-09-16T07:53:38.290 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 90.7% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.93299.log.gz 2024-09-16T07:53:38.290 INFO:teuthology.orchestra.run.smithi121.stderr: /var/log/ceph/ceph-client.admin.96775.log 2024-09-16T07:53:38.290 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95950.log 2024-09-16T07:53:38.290 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.29592.log: gzip/var/log/ceph/ceph-client.admin.96775.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.94705.log 2024-09-16T07:53:38.290 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.95950.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.96775.log.gz 2024-09-16T07:53:38.290 INFO:teuthology.orchestra.run.smithi121.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.29592.log.gz 2024-09-16T07:53:38.290 INFO:teuthology.orchestra.run.smithi121.stderr:gzip 87.7% -- replaced with /var/log/ceph/ceph-client.admin.95950.log.gz 2024-09-16T07:53:38.290 INFO:teuthology.orchestra.run.smithi121.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.96985.log 2024-09-16T07:53:38.291 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.94705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96525.log 2024-09-16T07:53:38.291 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.96985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93248.log 2024-09-16T07:53:38.291 INFO:teuthology.orchestra.run.smithi121.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.96985.log.gz 2024-09-16T07:53:38.291 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.96525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94207.log 2024-09-16T07:53:38.291 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.93248.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.96525.log.gz 2024-09-16T07:53:38.291 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96399.log 2024-09-16T07:53:38.291 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.94207.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.93248.log.gz 2024-09-16T07:53:38.291 INFO:teuthology.orchestra.run.smithi121.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.94207.log.gz 2024-09-16T07:53:38.291 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96013.log 2024-09-16T07:53:38.291 INFO:teuthology.orchestra.run.smithi121.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.94705.log.gz 2024-09-16T07:53:38.291 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.96399.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96399.log.gz 2024-09-16T07:53:38.291 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.96013.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96013.log.gz 2024-09-16T07:53:38.291 INFO:teuthology.orchestra.run.smithi121.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.95665.log.gz 2024-09-16T07:53:38.398 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-osd.3.log: 93.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-16T07:53:38.641 INFO:teuthology.orchestra.run.smithi121.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.31309.log.gz 2024-09-16T07:53:39.776 INFO:teuthology.orchestra.run.smithi121.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-16T07:53:44.289 INFO:teuthology.orchestra.run.smithi172.stderr: 92.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-16T07:53:44.310 INFO:teuthology.orchestra.run.smithi121.stderr: 92.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-16T07:53:44.658 INFO:teuthology.orchestra.run.smithi172.stderr: 92.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-16T07:53:44.660 INFO:teuthology.orchestra.run.smithi172.stderr: 2024-09-16T07:53:44.660 INFO:teuthology.orchestra.run.smithi172.stderr:real 0m6.459s 2024-09-16T07:53:44.660 INFO:teuthology.orchestra.run.smithi172.stderr:user 0m12.199s 2024-09-16T07:53:44.660 INFO:teuthology.orchestra.run.smithi172.stderr:sys 0m0.509s 2024-09-16T07:53:44.998 INFO:teuthology.orchestra.run.smithi121.stderr: 93.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-16T07:53:44.999 INFO:teuthology.orchestra.run.smithi121.stderr: 2024-09-16T07:53:45.000 INFO:teuthology.orchestra.run.smithi121.stderr:real 0m6.803s 2024-09-16T07:53:45.000 INFO:teuthology.orchestra.run.smithi121.stderr:user 0m14.466s 2024-09-16T07:53:45.000 INFO:teuthology.orchestra.run.smithi121.stderr:sys 0m0.633s 2024-09-16T07:53:45.000 INFO:tasks.ceph:Archiving logs... 2024-09-16T07:53:45.000 DEBUG:teuthology.misc:Transferring archived files from smithi121:/var/log/ceph to /home/teuthworker/archive/matan-2024-09-16_07:15:55-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7906859/remote/smithi121/log 2024-09-16T07:53:45.001 DEBUG:teuthology.orchestra.run.smithi121:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-16T07:53:47.538 DEBUG:teuthology.misc:Transferring archived files from smithi172:/var/log/ceph to /home/teuthworker/archive/matan-2024-09-16_07:15:55-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7906859/remote/smithi172/log 2024-09-16T07:53:47.539 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-16T07:53:49.591 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-16T07:53:49.600 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-16T07:53:49.601 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-16T07:53:49.604 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-16T07:53:49.688 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-16T07:53:50.347 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-16T07:53:50.347 DEBUG:teuthology.orchestra.run.smithi121:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T07:53:50.350 DEBUG:teuthology.orchestra.run.smithi172:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T07:53:50.365 INFO:teuthology.orchestra.run.smithi121.stderr:bash: line 1: ntpq: command not found 2024-09-16T07:53:50.367 INFO:teuthology.orchestra.run.smithi172.stderr:bash: line 1: ntpq: command not found 2024-09-16T07:53:50.370 INFO:teuthology.orchestra.run.smithi121.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T07:53:50.370 INFO:teuthology.orchestra.run.smithi121.stdout:=============================================================================== 2024-09-16T07:53:50.370 INFO:teuthology.orchestra.run.smithi121.stdout:^* hv01.front.sepia.ceph.com 3 6 377 49 +2424us[+2471us] +/- 66ms 2024-09-16T07:53:50.370 INFO:teuthology.orchestra.run.smithi121.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 50 -4510us[-4462us] +/- 57ms 2024-09-16T07:53:50.370 INFO:teuthology.orchestra.run.smithi121.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 47 +2451us[+2451us] +/- 60ms 2024-09-16T07:53:50.370 INFO:teuthology.orchestra.run.smithi121.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T07:53:50.373 INFO:teuthology.orchestra.run.smithi172.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T07:53:50.373 INFO:teuthology.orchestra.run.smithi172.stdout:=============================================================================== 2024-09-16T07:53:50.373 INFO:teuthology.orchestra.run.smithi172.stdout:^* hv01.front.sepia.ceph.com 3 6 377 47 +2441us[+2568us] +/- 66ms 2024-09-16T07:53:50.373 INFO:teuthology.orchestra.run.smithi172.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 48 -4496us[-4369us] +/- 57ms 2024-09-16T07:53:50.373 INFO:teuthology.orchestra.run.smithi172.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 50 +2424us[+2551us] +/- 60ms 2024-09-16T07:53:50.373 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T07:53:50.374 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-16T07:53:50.382 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-16T07:53:50.382 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-16T07:53:50.392 DEBUG:teuthology.orchestra.run.smithi121:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-16T07:53:50.477 DEBUG:teuthology.orchestra.run.smithi172:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-16T07:53:50.544 DEBUG:teuthology.orchestra.run.smithi121:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-16T07:53:50.574 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T07:53:50.574 DEBUG:teuthology.orchestra.run.smithi172:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-16T07:53:50.605 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T07:53:50.606 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-16T07:53:50.615 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-16T07:53:50.622 INFO:teuthology.task.internal:Duration was 1640.826218 seconds 2024-09-16T07:53:50.623 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-16T07:53:50.630 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-16T07:53:50.631 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-16T07:53:50.633 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-16T07:53:50.671 INFO:teuthology.orchestra.run.smithi121.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T07:53:50.686 INFO:teuthology.orchestra.run.smithi172.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T07:53:50.817 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-16T07:53:50.817 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi121.front.sepia.ceph.com 2024-09-16T07:53:50.817 DEBUG:teuthology.orchestra.run.smithi121:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-16T07:53:50.868 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi172.front.sepia.ceph.com 2024-09-16T07:53:50.869 DEBUG:teuthology.orchestra.run.smithi172:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-16T07:53:50.899 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-16T07:53:50.899 DEBUG:teuthology.orchestra.run.smithi121:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-16T07:53:50.911 DEBUG:teuthology.orchestra.run.smithi172:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-16T07:53:50.967 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-16T07:53:50.967 DEBUG:teuthology.orchestra.run.smithi121:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-16T07:53:50.978 DEBUG:teuthology.orchestra.run.smithi172:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-16T07:53:51.105 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-16T07:53:51.115 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-16T07:53:51.116 DEBUG:teuthology.orchestra.run.smithi121:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-16T07:53:51.141 DEBUG:teuthology.orchestra.run.smithi172:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-16T07:53:51.166 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-16T07:53:51.175 DEBUG:teuthology.orchestra.run.smithi121:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-16T07:53:51.184 DEBUG:teuthology.orchestra.run.smithi172:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-16T07:53:51.205 INFO:teuthology.orchestra.run.smithi121.stdout:kernel.core_pattern = core 2024-09-16T07:53:51.230 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern = core 2024-09-16T07:53:51.257 DEBUG:teuthology.orchestra.run.smithi121:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-16T07:53:51.272 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T07:53:51.272 DEBUG:teuthology.orchestra.run.smithi172:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-16T07:53:51.312 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T07:53:51.313 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-16T07:53:51.322 INFO:teuthology.task.internal:Transferring archived files... 2024-09-16T07:53:51.323 DEBUG:teuthology.misc:Transferring archived files from smithi121:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/matan-2024-09-16_07:15:55-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7906859/remote/smithi121 2024-09-16T07:53:51.323 DEBUG:teuthology.orchestra.run.smithi121:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-16T07:53:51.357 DEBUG:teuthology.misc:Transferring archived files from smithi172:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/matan-2024-09-16_07:15:55-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7906859/remote/smithi172 2024-09-16T07:53:51.358 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-16T07:53:51.390 INFO:teuthology.task.internal:Removing archive directory... 2024-09-16T07:53:51.390 DEBUG:teuthology.orchestra.run.smithi121:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-16T07:53:51.394 DEBUG:teuthology.orchestra.run.smithi172:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-16T07:53:51.441 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-16T07:53:51.452 INFO:teuthology.task.internal:Not uploading archives. 2024-09-16T07:53:51.452 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-16T07:53:51.461 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-16T07:53:51.461 DEBUG:teuthology.orchestra.run.smithi121:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-16T07:53:51.463 DEBUG:teuthology.orchestra.run.smithi172:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-16T07:53:51.476 INFO:teuthology.orchestra.run.smithi121.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 16 07:53 /home/ubuntu/cephtest 2024-09-16T07:53:51.496 INFO:teuthology.orchestra.run.smithi172.stdout: 265533 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 16 07:53 /home/ubuntu/cephtest 2024-09-16T07:53:51.497 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-16T07:53:51.507 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-16T07:53:51.530 INFO:teuthology.run:Summary data: description: crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore tasks/rados_api_tests} duration: 1640.8262176513672 flavor: crimson owner: scheduled_matan@teuthology success: true 2024-09-16T07:53:51.530 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-16T07:53:51.634 INFO:teuthology.run:pass